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ABSIRftCT 

This report is a ccaposite of the evaluation lethods 
and findings derived froio national evaluations cf experiential 
^ducaticn prograis* Section I, an overviaw of asiessing experiential 
education^ has tuo chapters: an introduction which discusses the 
oriqins and current trends of experiential education and id^entifies 
the purpose of the study; and an outline of goals^ outcomes, and key 
featurfs of experiential education prcgrais. Section II takes a 
clcser lock at five experiential education prograis: Experience-'Based 
Career Iducation^ the Career Intern Prograa^ Executive High School 
Internships Prograi^ cooper Jfelve education prograas, and Neighbcrhocd 
youth Corps, Each vignette answers the following guestions afcout the 
particular prograi:' How was the prograi developed? Who are the 
participating students? What are its goals? What are its key 
eleien^s? How was the evaluation doiie anl nhere is it reported? What 
are the evaluation findlnqs and what are the evaluaticn probleiBE? 
Section III, which presents conclusions about assessing experiential 
edneatlnn, ^discusses the synthesis cf evaluaticn findings^ probleas 
in eva lea ting experiential education programs, and alternatives tc 
current practices, k selicted blbllcgraphy is appen^^. (LHS) 
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FORiWORD 



Expartential education has beeniht prgdominant form of l@aming throughaut hi^ory. Vooa- 
tionat tdu^tion has baen a part of experiential^ eduaation through Its liadarship in e^abllshlng 
.€Mptratlvt.^du£flttori pmgmrns; Sinct thi^eady 1970$ thart bas been a movement in edugatioi^^ 
expand/the Muoatlonal oppoitunities of all itudenti to include real world laarning experlinoes as 
part of thetf educational pr^rams. To meet the needs of researoh, the Natlondl Center for Research 
ir^^VoGationdl Education has Mablished a programmatic effort to Inve^ig^e the experiential edu- 
64tlOniphenomenon. - " , i_ ^ ^ ^^^^'^^^ 

i As IS the casi with other Innovative educational programs, there is a need to evaluate the effec-' 
tivines pfthe lanovatlon. While much activity has taken place with re^^rds to evaluating experien' 
tial education pfogpams, much needs to be done, This timely report brings together a composite of 
the evaluation methods and findings that have been derived froni national evaluations of experien- 
tial educdtbn programs, As the report sugge^s, there Is a diversity of evaluation problems that st^l 
require resear9h tb provide ahswers tathe perennial questions of program effectiveness. ^ 

This proj^t was undertaken with support from the National Institute of Education'(NIE), 
S^Mial appreciation is extended to Dr. Ronald Bucknam, NIE Project Off leer for his help and con- 
tributions throughout the project, ' ' 

The report v^s prepared by Dr. Michael R. CnDwe, Project Director; aqd^pr; Kay Adams, t ^ 
Re^arch Specialitt. Dr/Jerry P. Walker, Associate Director for Evaluation, was the Principal 
Investigator, Thoughtfurand useful suggestiohs for revising the report were provided by Dr. Roy 
Butler of f?lf National Centgf . 



Robert E. Taylor 
Executive Director 
ThQ National Center for Research, 
in Vocational Education 
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SECTION I V 



OVERVIEW OF ^ 
ASSES8INQ 

EXPERffiNTIAL EDUGATION 



In order that the reader may have a clear view of where he/she- is heading as this report Is ex-^ 
amined, p brief desaription of the contents preceeds each major section. 

^ Section I contains two chapters^ The first delv^ into the origins and trends of exptriential 
education, taking us back to the time when people learned through experience how to feed, clothe, 
and warm themstlves. Moving to more modern times, chapter 1 considers the vanous forces which 
have caused a resurgence of interest in experiential education and lists a variety of progfams which 
have sprung up as a raiult. This chapter concludes by identifying the purposes of the report, qre- 
senting its focus, and lilting the criteria which wefe used to choose the evaluated programs. 

Chapter 2 has been built around three frameworks: 

* 

• goals 

• outcomes 

• key features of experiential education programs 

The evaluated programs can be grouped around five baiic goals. These goals have been used as the 
first framework by which to categorize the programs. Outcomes represent the second framework 
through which to^examine experiential education prograrras. We have considered not only desired 
outcomti! and societal outcomes, but potentially undesirable outcomes as well. A wide range of 
key features is offers as a third framework oh which to build an understanding of experiential 
education. For each framework in chapter 2 a charti is included which illustrates the concept 
being discussed. 



CHAPTER 1 
INTRODUCTION 



Origins of Expirianti^^ducation 

Since the early 1970s there hai been a movelfient in education to expand students' oppor= 
tunitiis by including prograrfis that provide learning experiences outside school. Much of this effort 
has been labeled experiential education which differentiates it from the academic or traditionat 
education. In their simplest form, experiential education programs emphasi^ learning through 
experitnce rather than through books. 

For example, if students were interested in studying Journalism they could approach the 
.subject in many ways; reading about it, looking at newspapers or magazines, observing others 
writing articles, or writing articles in a Journalistic style. Only the actual experience of writing 
articles in a journalistic style would constitute experiential learning; Obviously, this type of learn^ 
ing can occur inside or outside the school. An experiential program designed for students interested 
in becoming professional journalists would involve students in the actual work experiences of the 
occupation outside the school setting. Thus, in our example, the students would enter the Jour= 
nalists' environment, perform theiM^ork activities, jnd gradually acquire the knowledge and skills 
required to be a journalist. For purposes of this report, experiential learning means learning about 
work and other life roles by performing them and involves expanding the educational environments 
to places where those roles actually occur. 

Experiential education is not new. In fact; it has been the predominant form of learning 
throughout history. Prehistoric people learned through trial and error to feed, clothe, and warm 
themselves; in medieval guilds a boy learned a trade as an apprentice to a master craftsman; in early 
Affierica agirl learned canning, meat preservation, and sewing by daily experience with homemaking 
i^^ks; when learning began to move away from the home, many land grant colleges provided oppor- 
tunities for students to learn through experience in agriculture, engineering, and other practical 
i it)fects; within the last century there has been an increase in experiential education programs at 
f U' college level throu^^«mternships in medicine, teaching, law, social work, and many other fields; 
1 the secondary and upper elementary levels, students have been participating in experiential 
* .'cation through vocational eciucation co o(i programs, Junior Achievement, 4=H Clubs, and so on 
some time. - jj 

* f . 

Current Trends in Experjential Education 

Recently experiential Oflucation has gaining mornentUfTi at tfie socondary and post 
ficjary levej|j)f American education. A variety of inclividuols with cf-iffurent [)ef S[)Octives are 
ested in^this form of learniruj. For rAr.m[)lf}. 

• Stuci^Is are int^^resteci in roceivifnj aw education n.ori! lolnvafi' to tfiefr roles as adults. 



Employers arf^ p'eadiny for i^x[)er nMu:ed workers. 



fiurpmt of tfi§ Stu^ 



• SoGitty li anxious to all^ate tht problem of unemployed youth by providing paid work 
expf rienm (hat oan also be eduGatipnal. 

* ~ ' ' ' . . 

• Edu^ofi and parents went to asure that students graduate from Mluoationil ^rograrn| 
with specif ia competenales for peiiorming woric and life roles« 

• Educational policy makers want to rekindle public support for educatloH' through- more 
relevam pfogr amming. ^; 

• Taxpayers and Congr^ional representative are ooncerned. about the increased problems 
of unemployment, alienated ^vorkers, and misuie of welfare among youth. 

A variety of experiential education programs have sprung from this foundation of interest 
and concern. The programs have emerged under many names including: 



• Vyork experience programs 

• Work education programs 

• Manpovyer programs 

• Employment^and training progrims 

• Career education programs 

• Cooperative education programs 



• Work study programs 

• Pre-apprenticeshlps 

• Intirnshlps 

• On-the-job triining 

• Apprentlcishlps 



Purpose of tfie Study ^ 

There are two major purposes of this study: 

• to select experiential education programs from vocational education, career education, and 
CETA in order to ^mpare their goals, outcomes, and key features ^ 

• to examine the yvays the^ programi have been evaluated to identify evaluation problems, 
succissful evaluation strategies, and successfully measured variables. 



Focus of the Report . 

The experiential tducation progiams in this document were chosen on the basis b^tlie follbw 
ing guidelines: 

• They represent thi available range of pu» poses and features. 



> ■ 



INTRODUCTION 



• They have bttn rigorouily ivaluitad throuoh multiple itratagits, genaralizablt ^mples. - 
and a range of variably. ^ 

• They ara oparating In more than one tatting. ^ * . 

• T^ey appear to bt enduring over timt through adoptioni and adaptioni. 



• Th#y if® for )^0£/f^ age fouftaen to tw^my f Ivi, v 

• They are sponsorBd by schQols or iolntly by schooli and the employment communi 
rather than solely by employers or unions* 



• They provide initial training experiences outside the school faciliti 



Approach 

The basis for this report was a literature review which was supplemented with program mate- 
rials that focused on describing tfje goals and pperations of each program. Additfonally, more^ 
detailed and candid information about evaluation problems and successes was obtained fror 
unstructured personal intervievyiwith evaluatorsof eKperiential education programs. 
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e^OALS, OUTCOMES, AND KEY FEATURES 
OF EXPERIENTIAL EDUCATION PROGRAMS 




An experiential f^ducation program is usually considered- successful if it nneets its goals, if the 
learners demonitrate a positive change related to |he objectives, and if any unexpected effects of 
the program are positive. The purpose of this chapter is to describe"^ree frameworks. that^ were 
developed and used to provide initial answers to questions relating to goals, outcomes, and key * 
features of elcperiential education programs. These frameworks are based on th^ authors' experi- 
ences of evaluating an experiential education program and their synthesilof the literature. They 
are, therefore, subjective and holistic in nature. They were developed in response to the need to 
describe experiential education as a phenomenon occurring in educational settings, Many programs 
were reviewed, and according to the criteria described in chapter 1 the following five programs 
were selected for analysis in this report. 

• Experience Based Career Education (EBCE) 

• Career Intern Program (CIP) 

• Executive High School Internsh-^DS Program (EHSIP) 

• Cooperative Education Programs (Co-op) 

• Neighborhood Youth Corps (NYC) 



Goals of Experiential Education Programs 

In developing this f^iinework; considerations focused on tlie goals of existing e;:periential 
education programs. Fivu basic goals or purposes were identified: . 

• To tjtjild job skills. Some programs emphasize development of work skills, Work skills 
may include job knowledge and skills in entry level and advanced areas, 

• To strengthen dcmJenifc skills. Many programs emphasize the development of academic 
skills as a secondary focus. For example, the Career Intern Program worked with potential 
high school dropouts to improve both their reading and math skills and their interest in 
learning through a combination of mini courses and work experiences. 

To facf/itciti' curf}i-r exploration and development and life skills. Career education programs, 
sucfi as Experience Baseci Career EducatioM, f)rimarilv emf)hasize career development 
through exploration in work settings. 

• To facilftaw porsuriaf growth and tnutoratiorL Ex()eriential education firograms, such as 

. the Executi^^ High Schuol Iriternships Prugrani, ernphasi/e [)ersonal^rowtti and maturation 
through work experience. 

• To provide incorne and sucial reniediation for special m^^ds grotips. Programs sut , l^ETA's 
work experifMice profirams for youth and vocatiofial education work study programs prtma^ 
rily ernphasi/e ernfiloyrnent for tfie f3Urf)ose of transferring income to disadvantayed youtfi. 

I hemes such as skill nr career < jeveli m )fTient or acacJerTiic progress arf^ many times vitfw^^d 
as secondary [Xirposes. 



Moit .experiential education programs cut across these five goals with some emphasis on all of 
th€m, Few, if any, can be completely categorized by only one fl^fl- Most programs have a range of 
goals, some primary and some secondary, in order to help youth rfiake the transition from school 
to work. Figure 1 shows the framework that Was derived from the fivf^ goals. The figure displays 
the five programs in relationship to the primary and secondary goals of experiential education 
programs. 

Outcomes of Ex^wrientjal Education Programs 

Typical evaluation approaches include reviewing program objectives, constructing evaluation 
designs that use comparison or control groups (when possible), and developing evaluation measures 
and techniques that permit determination of how will stit^ objectives were achieved. Many pro^ 
grams state general kinds of expected outcomes rather than sp^if ic objectives. Because of heavy 
reliance on the use of stated program outcome^, it was necessary to develop an evaluation frame- 
work that describes experiential education program outcomes. 



Desired Outcomei 

Within a framework of themes and purposes, the specific goals of experiential education 
programs can be defined. HoweVer, since the prbffams are experiential in nature, many of the 
outcomes of these programs are elusive and difficult to define. The framework presented in Figure 
2 represents an initial effort to categorize the complex array of program outcomes of such pro ] 
grams. It snould also be noted that this array represents desired outcomes rather than actual 
measured tttainments. The outcomes encompass those for students and society, at ISrge^^as was 
discussed m the introduction of this report. Moreover, some of the outcomes are considered to be 
both positive and negative in nature. 

Societal Outcomes 

Some of the broad societal outcomes of experiential education programs are= 
*, involving the employment community in education; 

• changing the roles, respcnsibilities, and rules for educating youth; 

• upgrading the skills of those entering the labor force; 

• delaying formal entry into the labor market for part of the popu ation so others can assume 
rhR jobs; 

• increasing the demand for teenage labor; 

• supporting local economies through stipends to youth; 

• mcfHasing comn^nity support for educationahprograrns' 
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Figurs 1 



Primary and Secondary Goals of 
Elected EKperienttaf Education Proqrams 
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Figure 2 

Framework for Defining ths OutcopiM of Experiential Education Programs 
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• increasing the extent, to which nenvvKite youth pre substituted for w^ite youth in the 
lalpor market; ^ 

• incrBaiing the extent to which women and minorities .enter nontraditional occupations. 

Potentially Undesirabfe Outcomes ^ 

Critics of experlentfal education h^e posed some potentially "undesirable outcomes oKihese 
programs. For example, sach programs are criticized for— 

• tracking students into low pay-ng, dead-end jobs^ 

■ 

• lowering academic achievement by taking students away from regular classes; 

• necessitating higher costs for education (job supervision, transportation, etc.); 

• accelerating entry into the labor force rather than further education; 

• promulgating capitalistic and protestant work ethics in a one-sided manner; 

• accelerating premature maturation of young people by asking them to function as adults 
in work roles at too early an age; 

• providing free or inexpensive help to employers; 

• displacing older full time workers by substituting part time student learners. 

Experiential education program .outcomes are important to the extent that goals can be dif= 
ferentiaily interpreted. As the interpretation affects program outcomes, so the outcomes affect the 
evaluation design and thuf, the program's degree of success, - ^ 



Key Features of Experiential Education Programs 

The framework to Identify key features takes into account the fact that existing programs 
often take on a variety of forms and meanings under the general heading of experiential education. 
The programs vary on dimensions such as their purpose, the type of students they serve, their 
physical location, their length, their format and their sponsor. A framework of some of the key 
features of experiential education programs is presented in Figure 3 and described below. 



Framework of Key Features 

Purpose. The purpose of such programs can be viewed on a continuum with income transfer 
and productivity at one end and personal growth at the other. As discussed previously, many pro^ 
grams have multiple levels of purpose. » 
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GOALS, dUTCOMES^ 
KEY FEATURiS 



^Myment. ^udejlts receive fuN, partial, or no pav| for their expe/iences^ Students usually 
redeivji pay when tffliir participation results in employers' benefitting from the studehts' activities 
(i.e,, productivity) or to prov-ide income transfer to disadvantaged y^outh, ^-ittle ar'rro pay is iin- 
volved when students' experiences are g enera lly educational rathir than beneficial to the emp o'yers. 

^ Acadefntc credit. Students who complete experientiil education programs receive acai(e«nic 
^credit ranging from partial to none for their participation. In some cases it is awarded "pyst facto" 
throuftt 9 varfety of student assessments (e.g., written tests, oral exams, portfolios of wor/k; samples,* 
perfor/tiance testing, etc^. / . ^ ^ ( 

< ■ ^ ' 

Supervision. Experiential programs can be supervised completely by the school, compfetely 
by a participating business or industVy, or jointly by both agencies. Programs supervised by th^ 
school are som^mes called sponsored programs; thfe others, nonsponsored, 

Length of time. Great variety exists in the amoum of time students spend in work settings, In^ 

CETA and EHSIP programi, students spfnd the full school day in the same job for the errtire 
semester. In cp-op and wo/k, study programs, students spend only part of their day in a work set- 
png with the stiier part sp^tvin classes and other school activities. In EBC£ and other career edu= 
fcation programs, the studentf rotate through a variety of work settings for a semester as part of 
\ their school day. ' , * , 

\ . : ■ ■ 

Daily time commitment. The amount of time students spend in experiential prpgrams varies 
.from full time to part-time. The pattern ranges from one full day a week for an entire term, to > 
several hours each day for part of a term, to a periodic field trip. 

Work /academic mix. Some experiential education such as a work study program or a CETA 
program is just work experience. There are no courses oj seminars provided for students to inte-' 
grate what they are learning on the job with underlying.^rinciples and generaNz|tions. Others, 
like the EHSI Program emphasize work experience, flowever, students meet once a week for a 
seminar to reflect on what they are learning. Other programs like ^ vocational education co-op 
program and EBCE combine an equal mix of work experience and ^.elated classwork. Still other 
career education type programs like CIP are primarily acadefnic clasies with some field experience 
incorporated. i 

Type of wor/< setting. Experiential education occurs in a variety of work settings and occu- 
pations. A work study or CETA program may place students in unskilled or semiskilled^occupa^ 
tions such as fast food service, sales, groceries, janitorial, and hospital services A co=op program 
would generally plllte a student in semiskilled tectinital^ccuaations iuch as ^cn^rial, agribusiness, 
welding, or child care. A career education program sud^^EBOE might'placi i'suJdent in% range 
of occupations from unskilled to professionaL The EHSI Program provides students exposure to 
the work of government officials, doctors, and pther professional, and business people. . ^ N 

/— p . 

Plannmg of the work experience. Some progra/fis permit students to plan or contract for their 
experiences with little or no adult supervision duri^ the term. Others encourage joint plannmg by^ 
both teacher and student. StiH others are planned and contrblled solely by the teacher, while 
in others most planning is done by a participating employer. Since employers or community spon = 
sors have considerable control over the structure and context of students' learning/the value of the 
work experience dfien depends heavily on the employer. 
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^Studeht corriBmLtion, Ekperieritial educatiorr programs s#rve youth from fourteen^tQ twenty- 
one'and include sedDndary and ipostiteondary programs. The itarget audiet^e thty aerv# viri§6 as 
wilL Most rnjirrpovsfer^ work expfripntff programs and work stjdy programs serve disadvantaged'- <y 
youth. Vpei^ional education co-op progrims lerv^^g^fTarily ayirage youth, A prograrT^ such as * 
e6CE is for ail studenti whilMhe EHSI qro^ram geheraMy attracts gifted and above average youth. 

^o$t}o $chooL The per pupil cost of an experiential edypation program co\^s a wide range! 
The averaje costper pupil for a'aecondary vocational education^cc^op program is%125%vhile the 
career in^rn program (CIP) costs $2 J32./-Hov>j[ilver, the CJP coiti reflecj |he total educational 
program while the co-op figure repr^Ptttf only part of the cost for educating a vocational student. 

The importance of delineating the key features of experiential education prog^afrisdrto illus- 
trate that there ii no -singular treatment or program that repre^nts experiential education. Partly 
because of the diverse^student populations and local community needs, key features are combined 
in complex and unique ways to achieve program goals and outcomes. There does not appear to be 
a consist^ft one-to-one correspondpnce between key features and program gbals and outcofnes, 
That is, i#the goal is career development, the program may or miy not pay students for their expe 
riince. There Js'littte evidence available to ^upport the benefits of one key feature over another 
with regard to achieving similar program goals. It seems that the environmental context oi^ con- 
ditions leading to program development affeut the combinatiopi of key features (program activities) 
that eventually become an experiential education program. Tbe developjnent of prograrns may 
also represent the realiti^ of political compromise between eduqators and the work community, 
Thre point is that the programs are not a singular treatment based on a coherent theory of edu- 
cational instruction or youth devsJdpment, but represent a range of treatment all of which are 
believed to achieve similar ^'als. 

Development of Vignettes 

' ■ 
As described earlier, the following five programs werj selected for analysis: 

• Experience-Based Career Education (EBCE) / 

• The Career Intern Program (CIP) 

• Executive Hig^ School Internships Program (EHSIP) 

• Cooperative Vocational Education (Co op^ 



• Neighborhood Youth Corps (NYC) 



The vignettes in Section 1 1 are organized around the frameworks for describing the goals and 
key feftures of experiential education programs. Figure 4 compares the goals and their intended 
outcomes ffrom Figure 2) for each of the programs, while Figure 5 compares the key features for 
the programs. 
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, Figure 4 1 
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Compirison of tfie Key Feiturei gf 
. '^^^Five iicperiantial Eduoation Programs 
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SECTION \\ * 



c 

VIGNEtTES OF 
EXPERIENTIAL EDUCATION 
PROGRAMS 



Section M takes a closer look at five experiential education nr ^grarns. In fashioning a vignette 
of eacfi program, we have viewed it from various angles. 

u J ^ 

• How was the program develnped? .-^^ ' 

• Who are the participating studfjf tn? ^/ 

• What are its goals? ^ 

• What are its key elerrients? 

• How was the evaluation done and where is it reported r 

• What are the evaluation findings and what are the evaluai on problems? 

Chapters 3 through 7 sketch a few of the existing programs and offer a view of the immense 
diversity that is experiential education. The experiential education programs described in this 
section are: ^ 

• Experience Based Career Education 

• Career Intern Program 

• Executive High School Internships ProgratTi 

• Cooperative Education 

• Neighborhood Youth Corps 
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CHAPTER 3 
VIGNETTE ONE: EXPERIENCE^ 
^BASEDCARgEh EDUCATION* 



Introduction 

m 

The progrmi descripUpn for eacii \)roqr'm\ iricluded in chapters 3-7 % guided by Figure 5 in 
chapter 2. Jhe Bvaluatjnir^inclinqs for eacfi firograrn are fuesented in the order described in Figures 
2 and 4v 



Program Description 



Overview 



Experience Based Career Ecjucatsofi (EBCE) %\\o vs studenl&to participate in a series of short- 
term, individuahzed work ex[)eriences as part of their high school curriculum. After these explora- 
tion activities studentsniay choose to be exfjust^fj tu bevHfdt careers Ui.uuyfi career experiences in 
work settings. 



Student Composition 

EBCE is open to dll liiqii sctiool acjecj sti^^ its who likeao ieain uy doinq. Participants repre- 
sent a cross section of ability and achiovefne df^vels as well M sex and ethnic groups. It is not neces^ 
sanly a program for dropouts or for gifted studonts. althougfi [joth are represented. 

Prcgrafr. Development and Organisation 

EBCF began early in 1972. Under tfie sf)onsorsif^3 of tlie United :tates Office of Education 
(USUE) and later.the National histituteof Education ^NIEj, ynloi n: .uJelsof EBCE were developed 
and tested in four quite rjifferefit econoniic settings by four educationa laboratories. The Appalachian 
Educational Lahofutory ' ecjan a f:>rograrn usincj the governnient and industrial resc^urces of West 
Viryinuj's uapitai, Cfiarlestofi. Tfu.^ Far West Laboratory for tducational Research and Development 
set up Its Far West School in Oakland, California, an j' Ma with an etfinic mixture of blacks, Chicanos, 
'Asians, and whites. The Northwest f^«M|inna! Educational Laboratory establisfied Community Expe- 
riences for Career Eciucation (NWREL) in Tifjarcj^ Orenon, .i Portlafid suburb. Philadelphia's Research 
for Better Schools (RBS) [)egan its academy fof Cai^^^^r EfJucation in tlie dynamic: fioiiticai and 
economic atmospfiere o- thN- inner city. 

Tbe pilot test of t^in four EBCbniodf?ls ifivolved 600 students in (jrafles ten tiirough tweive. 
These original EBCE fTiodels (wihi cH:f:f)tn[)anyifKj iniijItMnentat ion (juidelinciS jnd cufnculum mate 
rials) are currently [jeinfj dissfirtiinated . USOL, t!iH)U{jh rlimr Part f) ()rngran^ lias provided con 
iiderable financial asshncUiee foi hcIiooIs interested in dciopting of adafstinq onr? of the EBCE frodels. 



'Adaf)ted ffurn f^^x W. Hfigans. '/Vfiat Is h xoeruMK-f^ HascMl C/*feffr rrlucation?' 
lllirH'^K Qirff^r t- iuciitint} J(}i inmi 33, No. J ihpn/vj If) ^"n) 
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The goals of EBCE as described by Cordor and Watkins (1976) are illurfTrated below. 



I. Career Development Skills and Knowledge 

M, The student Can integrate information about occupations with information 
about self. 

1=2, The student can locate and use information about occupations. 
1-3. The studefU has a positive attitude toward career planning, 

1=4. The student knows xm functions, characteristics, and requirements of a broad range 

of self selected occupajions, 

^\ ^ ■ _ 

15. The student knows some of the factors associated with selected occupations that 

contribute to job success and satisfaction.! - - ' 

1-6, The student will demonstrate that he/she has made an informed decision regarding 
his/her post high school educational/vocational plans. 

17. The student can obtain employment information, complete job applications, take 
interviews, write letters of application, prepare a resume, etc, 

18. Students who have tentatively selected a career area can begin to acquire some of 
the related job entry skills and experience, 

II. Self KnbwIedge: Interests, Abilities, and Values 

il l. The student can accurately demonstrate awaref ess and unaerstanding of his/her own 
current Interests, abilities, values, and limitations relevant ro career goal selection 
and achievement, and recognize that these may change with further education or 
experience, 

III. Reading Skilfs 

1 1 1-1 , The student can read selections from a newspaper or other popular periodicals, . 
and= 

a. recognize the main point(s); ^ 

b. recognize the author's purpose; 

c. locate specific facts and details. 

1112. The student can read and comprehend materials peftaining to his or her areas of 
career involvement, such as instructions, manufils, forms, parts lists, and technical 
articles. 
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1 113, The student can read and comprehend matehals appropriate to \:\$ or her 
avocartiopal and recreational interests, 

1114, The student can read selections required for educational or occupational 
actvancement and— 

a. define the author's purpdse and support that definition with evidence; 

b. identify and explain differ^t levets of meaning included in the selection; 

c. identify Wases with supporting evidence; 

d. extend interpretation beyond the printed infermation; 

e. recognize and describe differefrt writing styles. 

\y. PrOblem^Solving Skills ^ ' 

^V"1. The student can define his/her problem by identifying a need or a discrepancy 
between where he/she is and where he/she wants to be. This can be in a per- 
sonal, group, societal, academic, and/or career situation. 

I V 2, The student can use a variety of sources and techniques of data gathering. 

IV -3. The student can propose alternative solutions, anticipate consequences of various 
actions, and implement a course of action. 

v. Oral Communication 

V t. The student wilt^monstrate an ability to communicate orally both ideas and 

feeNngs in a manner that is effective and app?opriate to various situations (social, 
schoor, or work) . \^ 

V 2. Ti'ie student wih demonstrate an ability to listen effectively. 
VL Writing Skills 

VI 1, The student can expresb in writing idea^ and feelings so that most people ^aTi 

understand what was stated, * 

\ - 

Vi 2. The student cari write clearly and dorrectly the materials pertaining to his/her 
areas of career involvement (e.g., reports orders, records and forms). 

VI 3. The student can write letters, descrifitions, and re[)orts required in'riornial daily 

living. . . 

VII, Interpersonal Skills 

VII I. The stiitient can effectively participate in peer and adult interactions bas ed o n 

appropriate role relationships and obligations; accept the validity of inS^ual 
rights and perceptions; and contribute to th:' resolution of conflicts resulting from 
differing personal needs and values. 
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Vt^2, Tttrrtusftnt wllt^tmonititrtrthf aWtlty to ewperati wttti others ii^p mjwns of 
analning goals. 

V 

VI i L Basle Quantitative Skilli 

Vlihii The rtudent will demonstrate an ability to comprehend and interpret information 
pre^rfted numerically and graphically in newspapers and wee^^ews migazlnes. 

VIN'2. The student will demonstrate corre^ performance of aritoiTfetic operations neces- 
sa^ for succeuful daily living^ such as-- 

a. making and receiving change; 

b. modifying recipe quantities; 
__^c, measuring Items; ^ 

d. doing comparison shopping; 

e. generally dealing with weights, rriMsures, calendars, clocks, ate. 



Vill-3. The ^udent will demon^rate corre^ performance of mathematical operations 
nMessary for his/her chosen career, or for meeting the requlrementi for con- 
tinued study if a continuation of formal education is chosen as the next ^age 
in career development. 

IX. Maturation Skills 

IX-1 The student will demonstrate the ability to use direct souj'Cis (i.e., observations 
or interviews with relevant people) in greater proportion to indirect sources 
(i.e., books written about a topic) in pthering Information for reports or projects. 

1X 2. The student will demonstrate the ability to conduct conversations with an adult 
that reveals the student's self-confidence, abiRty to discuss a fixed topic for a 
reasonable amount of time, and an understanding of the other person's message 
and feelings. 

IX 3. The student will demonstrate the ability to cooperate with adults and aiiume 
responsibility for carrying out tasks which he/ihe agrees to complete. 

_ \ 
IX'4, The student will demonstrate an increase in behaviors that reveal a tolerance for 

people who are different in ideas or background than himself/herielf, m open 

ness to change, and a willingness to trust others when circumftancei warrant. 



Key Program Etiimenib 

The features of EBCE that distinguish it from other forms of instruction are listed below: 

• The fact that students are not paid for their work but receive academic credit and the 
standard diploma of their high school. 
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• A ttfong rommtintty eon s e r tiu m^r advisory boartf If rrrvolwd In poliey and diciiiOTT 
making. ' 

• A lyttem of accountability t(iat fortars students' assumption of responsibility and assures 
the program's aducational integrity. 

• An emphasis on using community sites as the principal bases for learning experiences. 

• An integration of the traditional role of teacher and counselor and a sharing of these 
roles with other adults in the community. 

An individualiied instructional system based upon assessment of student needs, prescription 
of experience-based learning activities and synthesis of community experiences. 

• A basic skills component that focuses or\^reading, writing, and mathematics as they are used 
by adults in the broad community. 



A life skills componenlBMiallowi students to obtain a variety of real experiences in 
political and civic activities, personal finance, and maintenance of persond^haalth. 

A career development component that guides each student through a sequence of career- 
oriented learning activities at various levels (exploration, in-depth investigations, etc.). 



The Students' Experien^ In EBCE| 

# 

The key program elements are woven into the dally experlencei of students In a variety of 
ways. For example, one EBCE student selected a railroad company, a business forms manufacturer, 
and a medical laboratory as learning sites. The student met and talked with a yardmaster, a tower 
clerk, a billing clerk, a carryall driver, a union representative, a salesperion, three lab technlclahs, 
and the laboratory director. From them, the student learned about the effects of routine and 
monotonous tasks on workers, the benefits and disadvantages of different union jurisdictions within 
a single company, the importance of being able to visualize design problems, the skills neceslary to ^ 
help clients articulate their own needs, the status of minority employment in two different firms, 
the advantages of different lab techniques, the Ir^portance of. a service orientation for business 
success, the approaching mayoral elections, and the Watergate hearings. With their guidance and 
the guidance of his learning coordinator, the student read a book on the history of unions and 
several chapters In a college text on clinical diagndsls and laboratory methodi. He helped to design 
a business form, program a computer to keep track of several train locations at once, and run a 
chemical test for pregnancy. He worked on upgrading his math skills in the area of ratios and 
percentages so he could complete a culture analysis. Throughout this entire process, the student 
^as treated as an adult, assumrt responsibility for meeting his own appointments and completed 
a complex science project at the medical laboratory, complete with performance object ives. In 
addition to the science projem, he also completed a numb¥r of less complex learning activities 
related to his diagnosed interest in politics and psychology. He then moved on to a project in the 
field of communications where he extended his already considerable skills in writing. 
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f¥ilya«or»of EB6E _ 

Multiple tvaluttlons of EBCE have be£i conduct 

Evaluation by tfM Four LaboratoriM 

EAeh of the four educational lafibratories conducted an extensive evaluation of the implement 
tation of Its EBCE modeL 

Method, These evaluationi included meral methods and instruments. For eximple: 

• Parents of students were sun/eyed about the EBCE prognni In which their son or daughter 
was Involved. 

• Resource persons from the community who had sponsored EBCE students were asked to 
respond to qu^ionnalres regarding their involvement. 

• All four programs measured the reading and arithmetic achievement of their experimental 
and control students using the CTiS on a pre^post basis, 

• At three of the laboratories, a 50 percent sample of experimental and control students were 
selected and interviewed by a third party evaluator. 

• The Assessment of Student Attitudes was given to both experimental and control students 
at two laboratory sites to measure attrtude towardi school. 

• Graduates of EBCE were Intirviewed by a third party tvaluitor to assess the after school 
effects of EBCE on studentl 

* • A variety of instruments were used to measure studehti' career development and self- 
development. • 
I 

Eviiuation of IBCE by fducatlon^l Tasting tervice (ETS) 

Information from students. ETS conducted an independent third party evaluation of EBCE 
using a variety of techniques. Interviews or questionnaires were admihlitered to students, former 
students, parents, and employers sorou the four EBCE sites. Information was collected from a 50 
pereent sample of experimental stCjdents and control students through a ''Current Student In^ 
Depth Interview/' 

The interview schedule measured variables such as the following: 

• Knowledge of general career areas. \ -^X 

• Career interests. 



• Knowl^gt of career requirtrntnti. 

• Selfrating of personal oharacttrlstici related to oareer Ghoices. 

• Oral communicatioh skills. 

• Attitude toward qareer planning. 

/ 

tnformstion from parenU. Parent questionnaires were completed by parents of EBCE stu- 
dents. Information was collected in areas such as the following: 

• Communication with their children about EBCE. 

• Contact with EBCE staff. • ' 

• Positive arid. negative changi^ioti^ in their children. 

• Perception of the relative importance, effectiveness, and improvement by their children in 
different areas of learning (e.g., perform occupational skills, be punctual, and organize time, 
etc J. 

• Parental attitude toward EBCE. 

• Perception of the strengths and weiknesses of EBCE. 

• Comparison of EBCE with past school eKperiencei. 

Information from former itudents. Interviews were conducted with a sample of former EBCE 
students. The "Former Student Interview'' focused on variables such as the following: 

• Type and length of work since graduation, difficulty in getting work, average number of 
hours worked per week. 

• Job satisfaction, career rftisfaction, 

• Career plans. 

• Type and length of education since fjigh schooL 

• Educational satisfaction, / 

• Educational plans. y 

Information from employers. A "Resource Persons Interview'' was used to collect information 
from members of the employment community regarding variables luch as the following: ^ 
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• How and why thty and their orgamzation beoame involvMi in ^CE 
Whether role, time, and cott r^uirements met their expectationi. 



Problems encountered. 
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uacy of information and help received from EBCi staffr 

• Perceived Impact of ESCi on their organiiation's quantity and quality of wo^k, hiring, 
and training practlq^, and total environment. 

• Description of program operating procrtures, 

• Effectiveness of the program, 

• Willingness to continue EBCE, and extent to which they would rtcommfnd^BCE to others 

• Strengths and weaknesses of the program. 

• Type of activities done with students (e.g., talk about job opportunities, teach students to 
perform job-related tasks, etc). 

• Perceptions of changes in their students' self^onlidenee, ability to ask questions, ability 
to respond to directions, ability to take the Initiative, and reliability. 

Ethnographic evaluation. In addition to the interviews and questionnaires described above, 
ETS used an anthropological perspective to develop a rich description of the EBCE programs in 
Oakland, California; Charleston, West Virginia; Tigard, Oregon; and Philadelphia, Pennsylvania. 
Data collection techniques included: 

• In-depth structured and unstructured interviews with silectid itudents and staff, 
\ • Informal interaction with program personnel and studenti. 

• Participant observation of itudent activities. 

• Establishment of an anthropology workshop for interested students. 

• UnobtrCisive measures of variables such as interaction patterns and group formation. 

• Case studies on reprewntative students (through self-kept journals of their daily activities, 
in-depth observation, lengthy interviews, examlnatipn of their academic records, and inter- 
viejft/s with staff about them) . 

tudy of records, documents, and reports about EBCE programs. 

• Examination of students* written work. 
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• Systsmvtic obstryition df studdnt totlvities over time (e,g,, sixty obstrvitlons were com- 
plettd at Far We^ School in Sah Frinciico^ Californjd) were us^ in various combinations 
at the flvij sites toprovldt ethnographic accourits of the program operations and outcomes. 

Reports of the evaluations conducted of the laboratory programs Include publications listed 
below: ' * 

Goldhammer, Keith et aL ExperlenQe-BasBd'^rmr Education: A Dmcriphnn of Four Pilot Pro- 
grwms Financ&d through the National Institute of Education, Final Repprt. Washington, D.C. 
National In^itute of Education, ED 1 18 833, 

The evaluation reports that follow ai^e among several that have been conducted on the Far West 
Laboratory for Educational Research and Divelopmint, located, in San Francisco, California: 

EmployerSBSBd Car&Br Education, Evaluation Report, Siptember 28, 1973, ED 117 297; 

Expert&nce-BMBd aroer Education: Interim E\mlu§tion Report, March 15, 1974, ED 1 17 296, 

Spotts,^obert et al. Experience-Based Career Education: Final Evaluation Report, 
2 W>lumes, 1974, ED 117 298, ED 117 299. 

Evanson, Jfll, and Spotts, Robert. Experience-Based Career Education Final Evaluation 
Report, November 1976. . 

Watkins, Richard W., and Jinks, C. Lynn. The Far West Model EBCE Experlence'Based 
Career Education: Evaluation Handbook, AprU Br 

Evaluations of the Northwest Regional Educational Laboratory, Portland, Oregon include: 

Herron, Marshall tt al. EmployenBased Career Education, 1973, ED 1 1 7 300, 

Employer-Based Career Education Evaluation Report, Washington, D.C.; National Institute 
of Education, 1973, ED 117 297. 

Final Evaluation Report of the NWREL Experience-Based Career Education Program, 

Washington, D.C.; National Institute of Education, Career Education Program, 1974, 
ED117M1. ^ 

Owens, Thomas R., and Fehrenbacher, Harry Evaluation of the Community Experiences 
for Camer Education Program, Ap(il 1974, ED 107 719. * 
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Riports of tvaluation of thg Appilachian Educational Laboratory, Charleston, West Virginia 
mcluder « ^ " . 

Rinion, James T, ©t al, ChsngBS In Stud&n^' Attitude ^ M&mur&d by a ^mantle DlffyrBn- 
tial Instrument^ Employtr-Based Career Education Technieal Report Number 39, 
Septembtr 1 973, E D 1 1 0 64B. 

Sayfarth, John T, it aL Studerits' Attitud&i Tdmrd the Program as Indjcated by an Analysis 
of Interview Data, Employtr-Based Career Eduction Technical Report Number 42, 
September 1 973, E D 1 1 0 648, 

Seyfarth, John T. it aL Parents' Attitudes To\Mrd the Program a$ Indicated by an Analysis 
of Interview Data, Employer-Bastd Career Education Technical Report Number 43, 
September '1973, ED 110 649. 

Hilderbrand, John R. et al. Experience-Based Career Education, Appalachia Educational 
Laboratory, Final Evaluation Report, September 30, 1974, ED 109 498. 



Exp&rienc0'Ba$0d fyreer Education, Appalachia Educational Laboratory, Interim Evaluation 
Report, March 15, 1974, ED 109 497. \ 

ShivelyVjWE., and Sanders, Jack. Alternative Education: Evaluation and Implem&ntation 
of fflCf /ami 1976, ED 121 842/ 1 

Reports on Research for Better Schools, Philadelphia, Pennsylvania include: 

FY 1973 Evaluation Report for the Re$earch for Better Schools Employer-Based Career 
Education Model, 1973, ED 109 496. 

Summative Evaluation Report 3: Interim Evaluation Report, March 15, 1974, ED 11 7 295. 

A series of nine reports are being developed by Educational Testing ^rvices In Berkeley, 
California which describe their evaluation methods and results. Those available as of January 
1977 include: 

Anderson, She!, and Drucker, Charles B. Experience-Based Career Education in Charleston^ 



West Virginia: An Anthropological Perspective, Volume if. 



Anderson, Shel, and Drucker, Charles B, Experience-Based Career Education in Oakland, 
California: An. Anthropological Perspective, Volume I IL 

i 

Smith, David M., and Theophano, Janet S. The Academy for Career Education: An Ethno^ 
graphic Evaluation, Volume IV. ^ 

Durgin, Edward C. An Ethnographic Account of (CE)^ Experience-Based Career Education 
in Tig&rd, Oregon, Volume V. 
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Xordtf* R§oinald, and Watkms, Rteihard Student Outcomes and Particwant Opinions in 
^ EBCE, Volume VI. j ^ 

Cordar, Reginald, and Wat kins, Richard W,* ^arch for and^ De)^lopment of Instruments 
M&asuririff Student Outcomes of Experience-Based Career Education Programs, Volume 
VI L - ^ 

Creech, F. Riid.< Behavioral Obsen^tions at Far West School: A Description of Experience- 
Based Career Education, Volume VI I L 

Trask, Anne E.^ ExD$rience-Based Career Education: An Inter-organizational Analysis, Volume 
IX. • 

An iKpellent summary of the EBOfi. eviluation conducted by the four laboratoriei and by 
ETS is noted Btlow: 

Bucknam, Ronald B. "The Impact of EBCE— An Evaluator's Viewpoint/' Illinois Career Edu- 
cation Journal, 33, No. 3, Spring 1976. * 



Other Evaluatlbns of EBCE 

Several other evaluations of EBCE are being conducted. These include: 



• Third party evaluations of the sites who have adopted or adapterf EBCE Using funds under 
^ Part D of the Vocational Education Amindments from USOE. * pproximately 1 15 schools 
are currently implementing EBCE and conducting evaluations of its effectiveness. 



The Center for the Study of Evaluation is developing a rgodel for auditing the third party 
evaluations of EBCE- i 

•f 

Research for Better Schools is conducting a longitudinal study of the long term effects of 
EBCE. 

" ^ f 

Huron Institute is conducting a three year implementation study of EBCE, 



Evaluation Findings 



The fallowing table pinpoints some of the major evaluation findings. The findings are drawn^ 
primarily from the article by Bucknam (1976), Other sources are noted in the table. The findings 
are organiztd by the framework of goals of experiential education programs presented in chapter 2. 



Summary of Findings from iviluations of EICE Programs 



OUTCOMES 


METHOD 


FINDING 


^OiVELOPMENT 

i 


. - . ■ i 

i 


No findings riportad. 


JobPlsement 
& Rittntion 

Placemtntin 
jobi or furthif 
^ iducition 


i 

Iriterviewi with former students 
one or two years after participi^ 
tion. 

e 


Students were liked what effect ElCi had on their prepari^ 
tion for further eduction and jobs, With regard to education, 
82 pircf nt iiid EiCi hid i positive effect while 6 J pircint 
felt the affect yvis nigativi. With ragird to efflploymant, 87 
percent said their programs had a positive effect while 3 per- 
cant felt the iffect was negitiye, 


J imployir 
Satisfiction 


- ■ ' ' " - " \ 

Intifviiws with 
resource persons, 

i 


The five most mentioned gains to the organization Msociited 
with liCi were: (1) gives exposure to the community, lets 
public know about ui, good public relations; (2) students are 
helpful; (3) students improve employii morila, improve the 
working environmint, keep stiff on thair toes, and are per= 
sonally satisfying to staff; '(4) Increase our knowledge of the 
commuf^ity and give us student opinions; (5) halps our training 
progrim, taachlng thytudenti helps employees, we learn from 
the students. w 


ACADEMIC 
DEVELOPMINT 

AcBdmic ^ 
Achmmwt 


PiFint queitionnaife. 


Eighty seven percent of the pirents with youngsters in EBCi 
thought the program was highly (46 percent) oHOmewhat 
(41 percent) effectivi in having students learn basic academic 
skills such as reading, writing, and mathemaiics. 
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Mith^mitici 



EducBtionil 

Attitude 
Towird 
Leirning 
& School 



Matturifnint sf iMpirimintal 
i32S| ind eontml |tlB| studinti 
using thru CTBS lubtiiti on 
> ''Reading Comprehinsion/' 
"Arithmetic Congep^/' and 

pre^poit baiii, 



Mfyufiment ofgSRBS EBCE 
ituden^ and 30 eentrol ftudm^ 
using thf Comprehmm T^t 
of fiai/c Skilli ovir a two-yf ar 
time ipdn, % 



Miaiurement of 14NWREL 
EBCE itydent^ar two^yiir 
tjmt span using CT6S. 



Parent questionnaire 



Ai^vnient of Student 
Attitudes (quiitionnaire) 



■ Y- — ' — ' — - 

The hypQtheiis that there would be no lignifloint differenee 
in ^emie achievements jSIn^ the EBCE itucknts would mm 
out on lomt regular elayei, it eould be hy^ikiiiied that th^y 
would luffer attdemially J Of the possible twelve eon^risoni 
(four laboritorlii and three lubtesti) ten were not significantly 
diffiriM w4fWo war^iiinW 

contrpi groupi (however, tN two e)ceeptloni are neither the sami 
lubtest nor the same laboritory program |. 



RBS itudenti showed slgnlfiaint firit^year growth on the two 
arlthmetie subteits and signiflMnt seeond^year growth on all 
three lubtesti, During the lennd year, EBCE students ware 
superior to the control In reading gomprehiniion ind arithmetic 
application. Two year cumulative growth for EBCE students at 
RBS dernonitration lite wis significant on ill CTBS subtests, 
and comparative growth over the two yeari was significantly 
iupirior toihe control group in both arithmetic subtests. 



NWREL'i dimonitration site showed significant growth In 
reading comprehension, arithmetic concepts and ipplicationi 
during the first year but not on a two year cumulative basis. 



One ofllpur changes most friquently mentioned by parents of 
EBCE participants was that their youngster ''has greater interest 
In ichool, ii more involved In school, and hai a poiitivi ittitude 
toward learning/' 



EBCE students {hid significantly more positive attitudes toward: 
education in general, the school curjjculum, school resources, 
school counseling, and the total learning environment than a 
comparible control group, 



/ 
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METHOD 



Pirent quiitionnairi, 



FINDING 



Ninety-five pifcint of parents with youngiteri in EBCE thought 
thi program was highly (83 percent) or lomiwhat (32 j^rcint) > 
effictive in having itudanii ll^arn mora about career opportu- 
nities. 



Interviewi with a 50 percent ^ 
umple of iKperimintal and 
control itudenti In EBCE were 
conductid by a third party 
iViluaton 



Former student intervliws. 



Miaiurament of 68RBS EBCE 
itudenti and 36 control Students 
over a two year time span using 
the Ammmt of Studm 
Attitudii To^itd School. 



The experimental group icorad significantly higher than the 
control group (x^ < ,001) on "ittitudei towards career plan= 



ning 



Graduates of EBCE were asked to namt the kinds of learning 
considered most useful to them one to two years out of the 
program. Of the four most mentioned, two were "how to 
plan a cariir, to pripiri, to ixperience, to know what I want 
to do and what I do not want to do" and^'how to relate to 
the feal world/' / ^ 



iS reported. 



During each program year, EBCE students at the RBS program 
showed increased growth on the fi^e subscalei of the instrument 
First year growth occurred In subscilei_ measuring student atti= 
tudes toward school curriculum, school counseling, and learning 
environments, Second year increaies occurred in attitudes 
lowird evaluation in general, school resources, and learning 
environmenis. 



PfRSONAkfiROWTH, 
DiVILOPMENT 1 

Silfliteem 


Parent intirviiws, 


Oni of four changss most frequently mentioned by pirents of 
iBCifMrtleipiflta WK thit their younfitir "^i m^e <^ 

fidince and nlf-ayurin^, wai more selr^reliant, and inqepen- 
dint/' 


Aeciptinci of 

RfiponiibilHiei/ 

Miturity 

a. 

■ 


m 

Pargnt intirviews. 

S ' 


Another qf the four ch^gis mait frequently mintioned by 
parenii EBCI^Icipants was that as a reiult of the pro-^ 
pm, their ybungstif *1s men nfiature, grown up" and 
''hsi griiter lense of fiiponiibility; is mo^liabli ind 
dipindibli; and Is working harder than befori/* Ninety-one 
peroent of parinti with Qhildren In EBCE thought the program 
wii iither highly (59 pe^ipntl or lomiwhat (34 percent) if fee- 
tivi In having itudenti learn reiponiibility. 


Formir student interviews. 


^ ^ 

Griduites of IBCi were ail(i|d to name the kind! of learnlngi 
^nsidered most useful to them ons to two years out of the * * 
progrim. Of the four most mentioned, Qne wk 'Viipon^ 
Sibil jty, silf^rsliinca, confidinci; how to get things done, and 
how to study and work hard." 


, Interpersonal 

sm 


Parint Interviews. 


f 

Ninety-three percent of f^irints with youngsters in EBCE 
thought the pr^ram ilther higHJy (63 ^/cent) or somewhat 
(31 ptrcentl iffectlve in hiving stgdinti learn to communi^ 
cati iffictivily with othefs. ^ 


Student intar^lws by a third 
party ivaluator. 


The exparimental group scofid lignificintly higher than the 
control gjoup (jc^ < .0011 on "oral communicition." 


Former Student Int&rviiws.' ' 

■ i . , 

4 .. . > 
I ".J' ' . ' ■ 

■ . i .■ '. ■■ ' y ^ 

i ■ 


\ 

; Grsduatai of'EBCE wire isked to name the kinds of learning 
\ considered most useful tbitheffl CKia or two years out of 
the pr^ram. One of thi moa Wiifitipned w^ "how to com- j 
munieate, that is to write and talk wi^idulti and peefi/' 



Ilguiii-Continuid 



OUTCOMiS 



SOCIAL 

REMEDIATION 

iconmic 
Indlcatsn 



Sockl Indlators 

School Retention 
I Complgtion 



COMMUNIS 
SUPPORT ' 



MITHQD 



Stydent recgrdi. 



Parent questionnaire. 



0 



Resourci person interviews. 




No findinp riportid. 



EBCi itudinti^rop out of jducitidn at a r§te of approximitely 
S-pircint whilrtontrol itudinfs drop out it i ratrof 15 pircehi. 



Thirty parints of EBCI pinicipanti wsri askid how the progrim 
CQmparid with their yoyngiteri' pist ichofil axpiHati^i. Ninaty 
^rcant of thi pirinti flit thit iBCE csmparicf fivoribly, while 
onFy 2J ptrcant CQmpired ISCE unfavorably, Additionally, 
90 ^reeht fiported they would wint thiir ydtjngitiri to pir^ 
ticipate In the EBCE program, knowing whit they know if they 
hid it to do again. About 5 percerit iild th^ vvould not, and 
about 5 percint iild thiy wire not luri, 



Of 202 Gommunity reioufca persons who iponsored EBCE studentif, 
81 percent said their organiiation would 'continue working vvit 
EBCE programs; 27 percgnt iild thay would corttinui to partici 
pate in EBCE with mora studants and 62 percent said they would 
conti|u^^Wjth about tfje iimi numbir of studf nti; 41 percent 
indicted that thi organiiition pined by participation in EBCE 
and 5p pffcent indicated tfl|t the orginization niither gained nor 
lost; ipd 96 percant.said ihey would recommend the EBCE pro= 
gram to Ahar resource organizations fo[ their potentiat lnvolvi= 
ment without reservations (76 percent) or with some reservations 
(20pirceai), 



Synthwt of Finding , V • 

EBCE bii faMn evsluatid through multiple Instruments from numeroui vintagt points using 
a wide yaritty of viH^iablas. Many pdsitlve findings^avt been accrued to the program. The program 
appMrs nottd hamper aoademic achievement altho^hf it takes students away from their regular 
clissei: It appears that EBCE helps-^ 

7 . ■ ' . . •• , 

• to improve attitudes to Wflird lining, 

to improva students' knowledgi of, attitudes toward, and skill in planning their careers, 

• to reduce high school drop out, and ^ ^ 



. • to facilitate students' self awareniflPristurity, and ability to accept responsibility. 

' ' ' 

Evalyation Problems 

^ On the othfr hand, the following should be noted: 

^9 Such a range of variables wert'^easured through the numerous evaluations of EBCE that 
the chance of generating significant finding! wasJncreased, 

> Much of the data in the career development and personal growth areas ^re based on teiti- 
rhonials by students and their parents. 

• Many of the oareer developmint and personal growth variables that were evaluated through 
more rigorous means did not produce iignificant findings. 
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CHAPTER 4 
VIGNETTE TVyd: THE CAREER 
INTERN PROGRAM* 



Program Description 

Overview 

The Career Intern Program (CIP) housed in Philsdelphia is an alternative for higr school drop= 
outs and those who are potential dropouts. Programs based on the CIP model are currently being 
initiated in other locations using funds from the Youth Employment Development and Demonstra- 
tion Act. CIP is not entirely an experiential education program since it provides classroom as well 
as experiential instruction. However, it emphasizes the work experience as part of its program and 
is intensively career oriented. 

CIP has two phases. Phase I consists of a ten-week set of courses intended to increase students' 
self-awareness and career awareness, and to review academic subjects. Phase 1 1 consists of courses 
of basic academic subjects, a career seminar, career counseling, and two weeks of work experience 
in the labor market. % 

Student Composition 

Students in grades ten through twelve who are not succeeding in their high schools are re^ 
cruited by obtaining iists of droputs and potential dropouts from high school counselors. The pro 
gram in Philadelphia served about 250 individuals, primarily black students. 



Program Development and Organization 

CIP was initiated in 1964 by the Opportunities Industrialization Centers of America, Incor 
porated (OIC). A self-help prograni ior blacks and ouier minorities, it began in an abandoned police 
Station in the slums of North Philadelphia. OIC has since grown to a network of more than 100 job= 
training centers across the nation. CIP is jointly sponsored by OIC and the Philadelphia School 
District, 

It is a small labor intensive prograrn run by a staff which has experience withViisadvantaged 
youth but does not necessarily have credentialed educators. The program provides a supportive 
atmosphere for youth who have been judged as failures in their previous schooling. However, the 
program does not allow students to ticape from the real world into an artificially secure environ 
ment. CIP deals with its interns as whole people. It has components for providing academic in 
struction, career and personal counseling, self preservation skiMs and job skills. Students are 
responsible for formulating their own career development plan iv ich guides their program. 



* Adapted from Richard A. Gibbonny Associates^ The Carncr Intern Hrngram Final Report. 
Volume I: Afi Experinmnr in Career rdiicutiot! and Vohnne 11: Trfciinical Ap^AJfidires. Blue Boil, 
Pennsylvania, 1977. 
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Program Dmcrwion 



The CIP coursi offtrings do not differ much from those in public schools. There are required 
courses, a career counseling seminar, and a few tlectivei. However, the classes are smaller and more 
open ended. The CIP semesters are ghIy iwenty^two weeki long and no grade distinctions are made. 

A career counseling seminar emphasizes individual study of careers and peer group counseling. 
The two weeks of work experience emphasizes learning both job skills and good work habits. 

Goals 

The goals of CIP are: 

1 . To help interns feel better about themselves and the amount of control they c^n exercise 
over their lives. ' * \ 

2. To help interns begin to gain greater amounts of Information about careers and a better 
ability to make plans for careers. 

3. To increase Interns' career awareness and use of career Information resources. 

4. To upgrade Interns' cognltlve^skills and academic achievement. 

5. To Improve Interns' vocational adjustment and carepr planning orientation. 

6. To increase the number of interns who remain in and complete high school. 

7. To improve Interns' !( ng-term career development In terms of employment and 
continuing education. 

Key Program Elements 

Some of the keyTeatures of CIP include the following: 

• CIP is a program for high ichool dropouts and potential dropouts. 

• CIP is a small labor intenshve program serving about 200 youth at one tirne. There is a 
1 : 1 5 ratio of adults to students. ^ 

• The principal provides instructional support in addition to serving as an administrator. 

• The staff is hired and supervised in a manner at variance with union negotiated agreements. 
The director can hire and fire without regard to seniority. Separation of functions is deli^ 
berately blurrefl; all staff are part of the team. The working day lasts ar long as required. 

• Cost per student is $2,732 based on an eleven month school year/ 
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CARliR INTiRN 
PROGRAM 



• The tnrollses in CIP are called interns rather tha^ students. No effort is made to provide 
extra-curricular offerings common in traditional high schools, 

• CIP deals with interns as whole people; they are seen as individuals, 

• CIP providii a school e^cperience congruent with realistic life goals. 

• CIP does not buffer interns from failures and frustration. It attempts to make their 
experiencing real. 

• Interns sat specific goals for themselves through a Career Developmen^Plan. Students 
are trusted with a major role in planning their own programs. 

Program Problams 

• Informality has sometimes encouraged world^wise interns to pit staff against each other, 
e Conflicting standards for awarding academic credit has been confusing to interns. 

• Retraining school staff to function in a distinctively different setting has been difficult. 

The Experiences of a CIP Intern 

Eddie's story tells of the obstacles some public school students meet in trying to get a diploma. 
Eddie had a pretty^ood idea of what he wanted to do with his life, but the problem was that he 
had been unable to obtain his diploma. Without it Eddie knew he would have to take whatever he 
could get on the street. He had seen too many frightening endings out there to settle for that alter- 
native. Here is his story. 

When his family moved from West Philadelphia to Germantown, Eddie breathed a sigh of 
relief. He had be^n dodging gang members in the old neighborhood for two years and he was glad 
to leave the scene of the battle. In spite of a new neighborhood and a new school, Eddie found 
himself righting the same battle. There were new gangs to deal with, and he was not doing much 
better at the new high school than he had at the old. He refused to enter the gang scene which he 
knevKwould lead to his dropping out of school. At the same time, he could not be a part of the 
successful student scene, Eddie characterizes his own dilemma this way: 

If you're^a hoodlum (gang member), you're cool. If youVe not a hoodlum, you're 
'iced' (snubbed). If you're a 'bookworm/ they call you a dummy, ^ 

Eddie needed to find a place where he could be himself, and where he could get the understanding 
and help to finish high school. ^ 

CIP vyas close to his school and he wandered over occasionally to check it out. 
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If you walk into a regular school, evsrybody stares at you like you're . . , somebody 
from a different planet. . . . over here (CIP) I found the school was together. They 
don't give you any hassles about what you're doing here, and how you got in, 

So the first thing about CIP that applied to Eddie was its atmosphere of openess. Eddie was ad- 
mitted to CIP in January WJ^- Before long he had endtared himself to teachers and counselors, 
taking an active role in stybent activities. Handsome ahd a stylish dresser who loved to flirt with 
the girls or spend an afte^u&onrapping with a teacher, he became involve in the Progressive 
Student Association, a stu^k^initiated group that functioned as a voice for Interns and planned 
student social activities. Aift member of the group, Eddie participated in planning dances and 
organising basketball gfmeAttwetn students and staff. During his second Semester at CIP, Eddie 
had a major part in a play written and directed by another intern= 

Eddie related especially well to adults, forming close friendships with many of his teachers 
and other staff members. As a result of his easy relationship with CIP staff, they entrusted him 
with responsibilities, such as relaying messages between staff members or helping teachers carry 
books from the resource center. 

Just about everybody knew Eddie. His classmates respected him for his efforts in their behalf, 
and his teachers and counselors saw him as special. He had found the place he was looking for at 
CIP. 

Because of his reading problems, however, it took him much longer to get through the program 
than many of the interns who entered CIP when he did. He had been in high school for five years 
before coming to CIP and had made it only as far as the eleventh grade. Like many students in the 
large high schools, Eddie's slow pace is probably attributable to his never having admitted his read- 
ing deficiencies. At the same time, no one was paying much attention to the fact that, after so 
many years, he had accumulated so few croiits. Eventually he would either have dropped out or 
he would have been dropped from t^e rolls. But in the supportive atmosphere at CIP, Eddie had a 
chance to admit his problems, and to se^k and receive the help he needed to improve. 

In his last semester^at CIP, Eddie was taking only one course because he had completed every- 
thing else he needed. He had had to repeat his English course once, but by this time, Eddie was 
reading adequately. One aspect of the school he complained about in his last semester was the pac- 
kets teachers were using in the classrooms. 

* 

His diisatisfaction is mixed with an understanding of their intent and the value of doing them. 
Somehow, his mixed feelings represent the movement Eddie had made toward an understanding of 
the value of school and toward increased self awareness. 

. , . i couldn't stand the packets , , , they ask you the same questions through the * 
whole packet. You finish one question and turn the page and you see the same 
question in a diliferent form . . . maytfe they do It to check you out, to see whether 
you're rushing through or whether you're taking your time to think about the ^ 
answers ... I always wanted to catch the guy that .nade up those packets. . . . Wetiad 
one of them called "How do you feel about yourself/' Well you're going to exaggeratfi 
to fpake yourself took good. But then if you took at it, you say, "Welt how do I feel 
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wtmmttmmm^m^mmmmmmitm^i^imam career intern 

^^^^■^^^■^^^^^^^^^■■■^^^^■^■^^^■■M PROGRAM 

about myself?" And if you really sit back and think of all the wrong things you've 
dont, you'd have to put down something different from what you first wrote. Or 
how do you feel at this particular moment? Nervous? So you really can't Just put 
down anything off the top of your head. You have to really sit back, read it, and 
thin think about what it asks you, and then write It down. It made you think. It 
was sickening. But I guess to a certain extent they ware alright. 



Unlike many of his fellow interns, Eddie had known for a long time what he wanted to be. He 
looked into other careers when he was at CIP and had six hand-on experiences during his stay, but 
his first love was electronics. 

When I was about eight years old, my father bought me a radio, I took that radio 
apart and he beat me. Then he said, "That radio bttter be workingr' I got the 
crystals back in and it was working,, That's what got me into it. Then I started 
dealing with a little bit of everything. It's fascinating, Vou take a radio that's 
a good twelve years old and you say, ''Wow, I'm going to fix this radfo," You sit 
down and get to pulling those tubes out, testing them and seeing which ones are 
no good. You put new tubes in and you might take the cord off because the cord 
had a break in it. You know, you can get a short circuit because of that. You 
take the cord off, and you put another one in there, slap it in tf^wall and the 
radio comes on. You see what happened. That's a trip. 

Recalling his favorite hands on experience, Eddie tells about working with an electrician for 
two weeks as he went from jo^ to job in the city, ^ 

I thought I knew a lot about being an electrician, I thought electrician and 
electronics were just about the same thing, until 1 had that work experience. 
First of all, I didn't really think about all the things electricians do and how 
they work, I thought to myself, "I'm really more interested in building things, 
electrical things," so I talk^ to that electrician and he showed me some other 
stuff he was working on, on his own time. It made me think about that career 
in a different way, but I knew I still wanted to .work with electronics, 

Eddie never entertained any ideas about going to school beyond high schooL His major goal 
was to get a high school diploma, A diplonna, to him, symbolized a clean break from the street 
scene that constantly lured him but that he so diligently tried to avoid. 

I really wanted to get a high school diploma. I know what it's like out there 
and I want to get a better job than just what I could pick up on the street. I 
really go to find out what I would have missed if I had dropped oiK. What 
opportunities I would have had. And that's why I'm glad I came over here: 1 
feel sorry for the people I see downtown. You see them sitting on the corner 
.or sleeping iti the street and you say, "Damn, will you look at that/' But really, 
if you sit back and think about it, you know, they cm get it, they can do it. 
Maybe it's because they feel sorry for themselves, like if other people don't 
try for them, they're not going to try for themselves. I'm not going to end up 
like that. 
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Evakmtion Findings 



With the help of his counselor, Eddie looked into opportunities for getting Into electronics. He ^ 
finally decided he was going to go into the Air Force, and applied even before he graduated. 

. At the CIP graduitlon ceremony in August, Eddie received an award for perfect attendance, =- 
The contrast of this award with his past school behavior is striking. Had Eddie not found afciace 
where he could be himielf, which gave him the support and patience to work on his reading\kills, 
he probably would never have graduated from high school, ' j 

Evaluation of CIP ^ 

A comprehensive evaluation of CIP was conducted by Richard A. Gibboney Associates, 
Incorporated (1977) with funds from NIE. 

m 

Purpose 

The evaluation was summative in nature and answered the following questions: 

1 . Do students admitted to CIP show significantly greater gains in cognitive skills, academic 
achievement, vocational adjustment, career selection strategies, realism of career choice, 
and self-image than those denied admission into the program? 

2. Do students admitted into the C IB' show greater gains in long-term career development 
than students denied admission? ^ 



Dates 

The evaluation was conducted January 1974 through February 1976. 

Sample ^ r 

Students were randomly selected from a list of dropouts/potential dropouts from feeder 
high schools and assigned to either CIP or a control group. This process was repeated for three / 
cohorts of students so there were three experimental and three control groups. The usable sample 
size was eighty four (experimental) and sixty-four (control). 

Method 

A pre-post, control group design was used. Pretests were administered as part of admissions 
interviews, The first series of posttests were administered ten weeks into the program. The second 
series of posttests were administered after one year. A follow-up Interview was used to collect 
career progress information from graduates of the program, 1^ addition, two full time field evalua 
tors conducteci a schedule of interviews and observations with samples selected froni the experimental 

\ 
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and control groupi. Some key questions werf ustd to focus thi interview but they were baiically 
unftructurtd and informal. Program observationi by the field evaluators were conducted both 
formally and informally. Observations were written up regularly and filed; observations were later 
reviewed, discussed, and synthesized. 

Data Analysis 

Analysis W covariance using the posttest score as the criterion and the pretest score as the 
covariate was used. A 3 x 2 comparison model compared the three experimental and control 
groups across the three cohorts. Descriptive Information from observations and interviews was 
compiled, interpreted, and used to supplement the quantitative data. 

Evaluation Findings _ 

Highlights of some of the major findings from the evaluation of CIP are presented in Fiqure 
7. _ 



Synthesis of Findings ^ ^ 

Overall, the evaluation results were highly favorable. Most outcomes increased, some signifi^ 
cantly for the experimental group. The program appearito have the greatest measurable effects 
on school attendance and retention, career progress aftewhjgh school, and vocational adjustment. 
The program had moderate effects on cognitive skills ancrtcademic achievement. Little measurable 
changes in self^mage were found through structured instruments, however, many changes in seif= 
perception were found Through observation and intervie^JNo measurable changes were found in 
perceived ability to influence future eve^is. 




Evaluation Problems 

1. Reading level of tests may be tqo demanding, for most interns, ^ 

2. There was a lack of fit between curriculum content f nd the content of tests, especially 
for the evaluation done early in ^he program. 

li 

3. S^dents' pretest scores on the self-esteem inventory were very high. This left little room 
for measurable growth in self=esteem. 

4. Students' scores in the Internal External Scale were not used in writing up the results 

of the study. It is assumed that this scale was noj found to be very useful in this context. 
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Figure 7 

Summary of Findinp from Evaluation of CIP 
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(SPMj by J= C= Raven: measures 
nonverbal reasoning using pictofial^ 
designs m stimuli (3045 minute^ 



Tests (SA Tj, Admced Battery by 
Richard Madden, etaL: measures 
academic achievement in reading 
comprehension and mathematics 
application (35 minutei): 
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^^f0'OevBlopmnt Inventory {CD 1 1 
f.^^\^ by Donald E. Super, measures 
Mt^t^cational maturity of adolescent 
' boVi^Jind girls througli an objective, 



FINDING 



No findings reported. 



Interns improved in general reasoning ability test 
performance while control scores did not change. 



Interns gained five academic months in reading while 
control scoris did not change. Interns gained four 
academic months In mathematics while control scores 
did not change^ Final levels of reading and mathematics 
evement were still far below national averages. 



No findings reported. 



Interns increased scores in all three areas more than did 
controls. (When used ten weeks into the program, this 
instrument showed no significant differenced The most 
gain oyer controls occurred in use of resources. 
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(30 minutes to one hour to complete). 
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drmfProgrs^: Entired 
colligi, placed on a 
job, or entered advinced 

tichi^ical training. 
I 


Two initruments were used to intirviiw 
graduates, An employer questionnaire 
was used to interview employeri of 
graduates. ' 

1 


Interns were substantially mora likely than controls 
to be In school, blightly more likely to be employed, 
and less likely to be involuntarily ''at home/' j 


( ^ Lif§Skilk 
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Pifceived ability to 
influence future 
, events= 


Future Oriinmion; IntmilExm- 
nslSalellESIb^f Julian Rotter: 
measures the degree to which the 
respondent eKpects that reward re= 
inforcement is dependent or inde= 
indent of his/her own behavior, The 
scale consists of 29 forced choice 
items, each item reflecting two con^ 
flicting statements from which the ' 
subject can choose (15 to 25 
minutes). 

i 


Ho significant diTferancas were found between treatment 
and control groups. 
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PERSONAL GROWTH 
DEVELOPMENT 






SelfAwarBness 






Salf^Concapt: General Silf- 
iiteem, social selfestiem, 
home parents self^istiim, 
and school acadimic self- 
istiim. 

\ 


SelNmBge: SBlf^Esteem Inmtqry iSEIj 
by Stanley Coopirsmith: measures 
general level of self=estee[Tj4hrough two 
forms. Form A contains 48 itums. 
Form B contains 25 itemi. A sample 
item is *1 'm a lot of fun to be with/' 
The respondent checks one of two 
coiurnns \ iiKg rne or uiiiiKe nit j, 


Although both treatment and control subjects rated their 
Silf^esteem highly, differencei between the groups were 
not significant. However, interns did improve in; assum^ 
ing responsibility for keeping and rescheduling appoint^ 
ments; completing assignments; participatmg attentively 
in classes; test^aklng skills, organizing to accomplish 
tasks; working topther; taking the initiative in seeking 
out resources, and seeing themselves as good students. 
On the other hand studints' internal standardi of excel- 
lence for themselves remained at a low leveL 1 nterns 
^tigti uiu uiq iiiiMiiftLini le^uifHiitgiiib lu y^L uy. 


Interpersoml Skills 




No findings reported. 


'Social 

REMEDIATION 






Economic Indmors 


— 


No findings reported. 


^ ^cibI IndiCdtOfS 






School AttendanD; 
and Retentiof") 


Rocords. 

1 


Only about 33 percent of the-interns dropped out of 
school as corTipareri with 85 percent of the control 
students. School attendance increased. However^ 
considerable suff effort, went into keeping attan^ 
dance high, 



VIGNETTE THREE; EXECUTIVE 
HIGH SCHOOL INTERNSHIPS PROGRAM* 




\ Program D^cription 

Overview 

The Executive High School Internships Program (EHSIP) qrovides an opportun' .Y for about 
2500 high school juniors and seniors from thirty school districts in nineteen states lo learn about 
organizational leadership #s interns to executives in business and government. The sponsoring 
executives include judges and attorneys, social service directors, government aHd hospital adniinis^ 
trators^ television producers and directors/newspaper editors, and research directors of scientific 
institutes. Interns spend a full school term, Monday through Thursday, at their placerpent working 
as administrative assistants without pay. They are immersed in the world of organizations, learning 
how decisions are made, and goals achieved. On Friday, interns attend seminars designed to re^ \ 
mforce practices of management, administration, and decision making. 



Student Composition 

Ninety percent of the students in the EHSI Program are semacs^O percent are juniors. Generally 
the interns are in the upper fourth of their class and plan tu attend c^ge. Students volunteer to 
participate in the program and there is overall a higher rate of female participation than male. 



J Program Development and Organization 

The Executive High School Internships Program began as a project in New York City in 1971 
as a joint undertaking between the city's Human Resources Administration, headed by Jule M, 
Sugarman, founder of Head Start, and^the Board of Education, whose chancellor, Harvery B. 
Scribner, had been selected in part to bring alternative education to the city's system. The EMS! 
Program design was developed by Sharlene P. Hirsch and was implemented during the fall semester 
of 1971 with one EHSIP coordinator and twenty students. During the 1972^73 schuol year the 
program was expanded to include twenty coordinators from the New York City School System. 
Also during this school year, seven other school districts began implementing the Program. From 
the 1971 fall term through the 1976 fall term, a total of thirty six school districts had at one X\mv. 
or another supported the EHSI Program, 6,919 students had chosen to be interns, and eighty six 
coordinators had been trained. The program has been adopted by school districts in twenty states 
and the District of Columbia. Generally, the program has been supported by local resourc'es rather 
than with federal support. 



■'Adapted from Michael R. Crowe and Jerry P, Walker, Final Report uii the Evaluation of the 
ExeCAitive High School Internships Program (Columbus, Ohio; The Center for Vocational Education, 
1977)._ James M. Weber, A Re exa/n/nation of the Design and Data Collected as Part of the Third 
Party Evaluation of the Executive hiigh School Internships Program (Columbus, Ohio; The Center . 
for Vocational Education, 1977) / 

47 



Program Dmcription 



Goals 
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Thtre arp two major goals of the EHSI Program. First, the program providei interns the op- 
portunity to learn from an in-depth ex^sure to the world of work. Students are placed with 
e^^acutives from business and other organiiations. Interns experience working in an organization 
so that they can appreciate the role of managers. Second, interns are expected to acquire a greater 
knowledge of themselves, greater self-confidence, and a foundation of personal habits th^ will 
better prepare them for work in an organizational environment. In addition to these two major 
goals, there are published performance objectives listing student behaviors related to (1 ) students 
developing a more accurate understanding of organizations and those who manage and adminisler 
them, and (2) students demonstrating the ability to function effectively in an organizational en= 
.vironmtnt withian executive. ^ 



Key Pfogram Elements 

The features of the EHSI Program that distinguish it from other forms of instructions are 
listed below: 

• Students volunteer to be interns and through a series of interviews with sponsors 
(executives) make choices regarding their preferences for a placement. 

• Interns are placed in an organization for a full school term. ^ 

• The sponsors are located within the executive level of their organizations. 

• The program provides consistent attempts to reinforce placement experiences through the 
use of logs, semlnarsfand projects, 

• Interns do not receive monetary compensation for their work, but do receive academic 
credit for their experiences. < , 

• Interns are slotted at management and executive levels. They are not expected to fill 
existing slots; rather each can get hands-on feel for what an executive's daily routine is like. 

• There is a full=time EHSIP coordinator whose responsibilities include recruitnient of stu- 
dents and sponsors, conducting seminars, providing counseling to interns, and managing the 
day to-day program operations. 

There is a national office, Exedjtive High School Internships of America, that provides 
coordinator training, curriculum materials, and technical assistance to programs upon 
request, ^ 




The Interns' Experiences in EHSIP 

The interns' experiences in the program are diversified and depend upon the'needs of the host 
organization and the personality of the sponsor. Interns are placed in organizations ranging in size 
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from 1 to 2 individuals to over 1000, Executive interns art expected to be provided with a place^ 
ment that offtrs them the opportunitV to observe and btcome mvolvtd in decision making by top 
officials, and to participate is pai^l of the professional staff. Although tach placement ripresanti 
a unique relationship resulting from the intern's and sponsor's interest and personalitv, there are 
genirallv three types of placements: special assistant internship, special agent internship, and ad- 
ministrativt servici combination.* 

; In the special assiitant internship, the students spend most of their time with the sponsor. In 
this type of internship experience, the interns, are given special assignments such, as attending meet^ 
ingi, writing reports, coUecting information for the sponsor, preparing draft correspondence, and in 
certain situationi representing the sponsor at meetings. The special assiitant Internship provides an 
opportunity for interns to experience bting a part of an administrative itaff 
^ . ' ' .x^ 

The special agent internship experience provides the interns with the opportunity to spend 
part of their time with the sponsor and the rimainder rotating through some of the organizatioh's 
depirtments under the supervision of the iponsor. This type of internship experience i| particularly 
popular with hospital administrators and provfdes the interns with a viewpoint about the total or ; 
ganizatioti. The administrative service combination internship provides the interns with the oppor- 
tunity to divide xh%\T time between management activities and direct relationships with clients. 
Thus, interns in a drug abuse center, for BX^mp|e,\might spend part of their tirrje with the director 
in management activities and the remainder of their time working with clients i/nder the supervision 
of staff professionals. 

The foilowing five vignettes provide the reader with examples of interns' experiences. The vig^ 
nWe^ are drawn from the evaluatiort reports of the program. 

Ned is a second semester junior. His sponsor is the vice president of marketing and research at 
the local sivings bank, Ned spent a week as a teller and as a savings counselor. Several weeks were 
devoted to studying other bank services, allowing him to cohripare those offered by his bank. Es^ 
pecially proud of a research report growing out of his telephone survey, he was able to monitor 
people's reactions to the services provided by the bank. In scientific terms,Jie carefully examined 
his random selection of 200 names from the phone book and his development of a survey ques^ 
tionnaire using a Likert format. ^ ^ 

He apologized for a 23 percent return rate but as his time at the placement was endlna, he 
wanted to write the report before he left. Ned felt the greatest benefit of the program was in help= 
ing him overcome his shyness. He safd he had been offered a summer job running the bank's pre^ 
mium program, 

Beth is a junior, a cheerleader, and t^member of student government. Her sponsor is the State 
Executive Director for Career Education. Responsible for organizing a statewide youth conference, 
Beth prepared letters announcing the conference, mad^ logistical arrangements for participants, and 



*Mopxe6 Uowi Basic Design: Executive High School Intemships Program. New York: 
Executive High School Internships of America;: 1976. ' ' ' 
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helped plan the agenda. She didn't realize how important her boss was until the conference was 
held. With teaching as a caretr goal, shi regarded what had been learned about education as In- 
valuable. A secdnd Internihip In-yet another area would be of interest to her. 
<^ 

Vivian chose her plactment at an archit^tural company because she liked mathematics and 
wanted to learn about engineering. Her sponsor is ont of the partners of the company. At first, 
Vivian spent her time doing calculations for the engineers, and preparing format letters for cus- 
tomers. After about four weeks she said the employees began to trust her, and she began to get 
assignments more like those she thpught an, executive Intern should have. Scheduling the Jobs that 
came into the company becar^ part of Vivian's responsibility. She explained how each Job has 
^several parts that must be completed in sequential orderi She prepared a job board that detailed 
;aach step of a jpb to aid the smooth flow^hrbugh various operations. This cut down delays in 
finishing a |ob. Vivian explained the^ompany was in financial trouble and had to terminate a 
draftsperson because the draftsperson was not producing. She felt sorry for the person but realized 
■ the necessity of economizing when profits are low, 

Marsha is an intern with the District Attorney's office. Her sponsor is /an assistant district 
attdrney. SHe has done undercover work for the agency and must maintain confidentiality regard- 
ing her work. She Is planning to go to laW school and upon graduation hopes to be a lawyer for the 
FBI. - . ^ 

Lana's sponsor is the president of an advertising agenfcy. Lana's responsibilities have Included 
representing the president at meetings during the two weeks he was in the National Guard, watching 
commercrals for clients, and attending meetings for new accounts. She said that the one thing she 
liked about h#r sponsor was his honesty. He would turn down an account if he dld-noi believe he 
could help a client,; She hopes to goto college and major in business. 

. Evaluation of EHSIP 

A national evaluation of EHSIP was conducted by the National Center for Research in Voca- 
tional Education, The evaluation was supported by the National Institute of Education, 

Purpose 

The evaluation study proposed to answer some crucial questions regardmg the effectiveness of 
an expanding experiential education program, and to provide a better picture of the program in 
terms of student grovvth and the instructional processes 6f program participants. 

Evaluation Design 

The design features for coiiductlng the evaluation of EHSIP are presented bt^low. 

Rmesrch Design: Six EWSI Programs were selected on criteria that provided a reasonabU: 
estimate-of their ronformance to the national model.. The treatment groups were those students 
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;(N - 1 19} who vQlunttered during the 1976 ipring term to be interni during the 1976 fall term. ^ 
The control groups were those students (N = 93) who volunteered during the 1976 spring term to 
b© jnttrns durinf the^^ 19?7"fprm9 tefffi, Both groups wtre administered pretesti and posttests 
during the 1976 fall term. The treatment students, sponsors, coordinators, and parents were ad- 
ministered a questiofinaire during the 1976 fall term. « \ . 

Instruments: Instruments w^e: management test dfsigned to assess student understand 
ing of organizations (both in terms'of their structure and the factors affecting the performance of 
their sponsors) as expressed in the program objectives; (2) Gordon Personal Profile and Inventory, 
six of the eight published scales and three derived iubscales, which were used t© assess studfents'^ 
abilities to function effecti^fly (in terms of good work habits, self confidence and communication 
skills) as expressed in the program objectives; (3) writing test (posttest only) designed to a^ess ttie 
students' abiltfy to write fluently and precisely as expressed in the performance objectives; (4) Intern 
Questionnaire which' provided the "treatment" students with an opportunity to describe^ their pro- 
gram relate(j experiences, their attitudes toward those experiences, and the changes they felt . 
occurred during the internship experience in terms of their abilities to function effectively ak de- 
fined by the performance objectives; and (5) Executive (Sponsor) Questionnaire, Coordinator 
Questionnaire, arid Parent Questionnaire vyhich provided the respondents with the opportumty 
to indicate the changes they felt occurred in their intern's abilities to function effectively as com- 
pared to the EHSI Program performance objectives, 

Analyses: Analyses performed on the data were: (1) analysis of treatment and control stu- 
dents' posttest scores from the evaluation instruments; and (2) analysis of gain scores and group 
'variations for treatment and control students. 



Evaluation Findings 4 ' 

^ _ . _ _ 

Highlights of some of the majOF findings from the evaluation of EHSIP are presented in Figure 



Synthesis of Finding ^ 

The quantitative data showed no'statistical differences, while the questionnaire and intarview 
data indicated overall the Jnterns were' achieving to a moderately high degree some of the perfor' - 
mance objectives of the program. With respect to the questionnaire and interview information, it " 
would appear that interns are most successful in achieving the program objectives assQCi^ed with 
personal growth -awareness of skills and abilities and an increase in their sense of self-confidence. 
There is less evidence to support their acliievement of the performance objectives oT understanding 
organizationfj structure, executive performance, and communication skills. 



Evaluation Froblems * 

1 , Thf re was less than clear and consensuat knowledge and commitm^it to the learning ob- 
_., jective s g^i^^^iy of the interns, sponsors, and coordinators. 
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Summiry of Findiif|i from tfii Eviration of ^ EHSI Program 



OUTCOMi; 



J9S SI£il,L 
toiV€LOPME^T 



AGADEMIQ 
DEVELOPMENT ' \ ^ 

AcMimiQ AchiBvm§nt 



Cognitivi Skllli;* 
Undfritinding ^ 
Ofganizational ^ 
Structufe ind 
Ekicutivf 
Pirformanci 



\ 



No findings nported. 




METHQD 



Meaiurement of expfrimintal (fi9) and 
eontrol (93) itudinti uiing a Mana^iient 
Test deyfloptd to iiiasi stud^iti' ynder- 
itanding of org^niiati^ni as exprgytd in the 
program objictivis, Gain mm wiff com^ 
puted for iach of the tre^mant and corvirol 
students and group variations were analyzed.^ 



T 



In ern qutstionniire. 



.|j(ecutive queiti^niire. 



FINDING 



No significant diffarinces were obsarvag amqng 
the evaluation groups oh the criterion measures, 



Interns' salf^raports of the effeetivenesi of pro= . 
gram in helping them undarstand organiiatlonal 
itructure and executive parformanca conilitency 
showad that two=thlrdi of the interns felt they 
were learning about organizations and executjve 
parformance. 



Overall about two^thirds of the executivas (spon= 
sors) reported that thay felt the program was 
effective in helping intern? undarstand organiza= 
tional structure and executive performance. 



Parent questionnaire. 



Overall about two^thirds of parents reported that 
they felt the program was effective in helping 
interns understand organizational structure and 
executive performance. 
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Writing Skills 

! 


Meuuremen! of ixptrlmintal and control 

tfilHfihti inntHfiit nnlu\ liiifin & *iiAf\i^n tsit 
iiuyeriii i^iiifii yniyf uiiny g Afiung itii 

dislgned to aoty thg itudints' ibility to 
writf fluently ind prteiiely. 


No lifilfieint differincis were obsirvid among 
int iViiuiiion yroups on ine criierion miisuris, 

— — '~ — [ — , 


( ■ 


Inl^rn quistionnairi, 

V 


f ,^ 

y 

About hiif of thg interni reportid that writing 
Id^ inhineed their writing skilli. 


i 




About hilf of the Interni riportid that the pro- 
gram was efffctiva In improving their writing 
skills. 




ixecutive queitionnaire. 


About hilf of the sponsors reported a modarate 
increase in their interni' writing ibiiity. . 






About 80 percent of the iponiori reported that 
their interns wrote while at the placement and 
about half of those indicated the interns' writing 
was readibie and undiritandabie. 
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Eduatioml Ammm 
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^ Attitudi Toward 


itudtnti uling a queition with five responds 
ibout how well they liked lehooL 


ivy iiyillMLiilll Ul llEi^lfLca W^l^ UU^clV^ QMlyiiy 

the evaluation groups, 




Parent questionnaire. 


One'of the changes most frequently mentioned 
by parents of EHSIP partieipinti was that their 
youngster "likes school ind wm more motivated 
to learn m the EHSi Program when compared 
to past school experiences. 
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OUTCpMIS 


MITHOD N 


FINDINQ 


CAREIR DEVILOP. 
MENT&LIFISKILLS 
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* 

% 
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No findinfls riportid, * 
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EmploYability Skills 
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Work Habits 

i 

1 


1 

Meiiurimfnt of eKp^nmantal and control 
itudants using the GordQn Pimml Profilf 
§nd Invinto^, Thrie dirivid iubiCilai, 
which were not the lame aitha published 


No lignificant differences were observed among 
the evaluation groups on the criterion measures, 
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subscaiei, were usad to iise is students 
abilitiei to function effectively in terms of 
the good work habits e)(pr€iied In the 
^^rogram objectives. 
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Intern, sponsor, parent questionnaires. 


Overall twoihirds of the interns, sponsors, and 
parents reported that the program had bean 
effective in halping^udents aecomplish the 
work hibits= 7^ 


/ 


Iritefn and sponsor interviews. ^ 


The evaluatori raportad that many of the students 
already possessed Wrk habits before they entered 
ina prggram, \ 


Devflopment ok 
Job Contact! 


\ 

'i 

Sponsof questionnaires, 

f-^ 


\ 

Over thfee-fourths of the sponsori reported: 
(1) they would consider hiring the intern as a 
fulhtime or part^ime employee, (2) they would 
recommend the program to other organizations, 
and (3) they and their organization would con- 
tinue to work with the Drooram 


Life Skills 


i 


'» .-■ ■ - 

No findings reported. 
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itudinti uiing thi Gordon Pinonsl Profib 
ind Inrntory, Thrii dirlvid subiOilii and 
four of thi fix publishid lubioilis win u^d 
to asuii itudenti' iwarineii of ikilli and 
ibilitiii and sinsi of stlfconfidenci, 


: ♦ 

lignificint diffirencei were obiervid imong 
thi ivalyation groups on the criterion miasurai. 


A^ptanee of 

Risponiibilities/ 

Maturity 

V 


Intfrn, sponiar, ind parant qyeitlonnalfii. 

f 


^^yirall two-thirds otxthe interns, sponsors, and 
itarints rsported that they felt the program hid 
biin effectiyi in hilping itudenti bicome awara 
of themif ivii and ihow iilf^conf jdinai. 


Impmonal Skills 
Relations with Adults 

/ ■ 


Sponsor questionnaire. 

4 


Ovar half the iponiori reported that; {1)the 
intern worked aagarly with otheri and was easy 
to work with; and (2) the professional staff h^ 
strong ^ittive feelings about the intern, 


^ Oral Communicstion 


Sponsor queitionnaire. 


About 50 percent of the sponsors raportad that 
their Intarns were highly fluent and^ initiated 
GOnversationi with adult workers. 


^ " " " " - 

SOCIAL REMEDIATION 
, Economic IndicBton 


— 


No findings reported. 


uULiBf inutCdwn 




Nofmdmgs reported. 


COMMUNITY 
SUPPORT 


Interviews. 

... ■ • H 

! 


Although intarviaws were not structured to 
collect frequency data, the Impresiion of the 
avaluators was that the sponsors, parents, and 
interns ware anthusiastic atout the program. 
School administrators at the central office staff 
ware supportive while principals, counialors, and 
teachers generally expressed concern atout stu- 
□enis leaving scnooi lOr a lull scnooi term. 





2. Although mstrumtnts wtrt devtloped and/or ititcted so that thty were keyed to pen 
formanca objaativas, thay may have btan insansitiva to tha program's objectives. 

3. Aff hdugh^ha rahtrD^ voluntaarad to be In the program at the same time as.the 
treatment studants,%ity may not have been Mmjiirable as Indicate by their pretest 
^seores. Also there wm a 2S percent mortality rate for the eontrol group. 

4. Comparison of Interni' priest i^ras to other groups' scores on the Gordon Persona/ 
Profile and Inventory indlcattd thai interns were more similar to first live! management 
penonnt I than to high ^hdOl ttudenfl. Thus, thert wM a re^rlcted range to show 

^ measurabfrgro^h. ^ * 
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Program D^ription; 



Overview 

There are a variety of programi that lie withjn thi gaijieral category of cooperative education or 
work study at both the itcondary and postsecoqdary Jevils ■ " 

In a cooperative vocational education program there is an afrangement between the ichool and 
employers. The student receives instruction by alt0m|tin| siuidy in school with a job in any occu^ 
pational field. These two experiences must be planned &>id siipWiied by the school so that each 
contributes to the student's education and to his/her empfpya^ility. .V\^ork .periods and schofil 
attendance may be on alternate half-days, full days, weeks, orother periods of time. 



Sacondary Cooperative Vpcational E^duoatioh Programi 



In the Vocational Education Amendments of 196)3, c9operative educat^n is prov^y^through: 
State Vocational Education programs (Part B), and thrCooperatlve Vocational Educatrm^proqrarni 
(PartG). - ^ 

0\/ervfew, The purpose is to provide onrthe^jbb work eKperience related to t/W student's 
course of study and chosen occupation. * ^ 

Student Comp0$itton, ' These programs are, for individuals in all areas of the state/ who desire 
such education and training. For Part G funds, priority is given to areas with high dropout rates and 
high youth unemployment. . \ 

Program Organization. Co^op.programs are funded fully or partially through federal dollars. 
State vocational education programs are based upon statewide matching (fifty fifty) for all basic 
gr&nt vocationaJ education programs: Application of state critjeria for allocation of funds deter^ 
mines the level of assistance, » 

Cooperative vocational education programi receive 100 percent federal support. Funds are 
used for — 

. program operation and ancillary services; 
2. feimbursement of added training cost to em^yers when necessary ^ ' 



* Adapted from Asa S. Knowles and Associates, Handbook of Cooperative Education (London: 
Jossey Bass, Inc.. 1971 ); and Robert W. Stadt and Bill G. Qooch, CpoperativB Education (Indianapolis 
The Bobbs-Merrill Company, 19/7). ' 
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3. payment for certain service or unusual costs td studtnts while'in coopirative training. 

Co-op programs art administgrid by tht state or local aducational agencies under supervision of the 
Stati Board Jor Vocationa! Education in accordanqe with state plan provisions. ^ 

Co-op programs' are offered in a variety of occupations including: ^ ^ / 

Business and office procedurt ^ 

Distributive education 

Home economics , i i , - 

Trade and industrial skills 
Off farm agricultural business 
Intfrrelated programs 

Special purpose programs . ' 

Health occupations 

Co-op programs employ a teacher coordinator who is trained in coordination techniques and 
has had work experience in tht vocational fields his/her students are pursuing. The teacher coor- 
dinator advises students, identifies suitable training stations for thern, teaches a class in school 
which is closely related to. the experience on the job, and evaluates the learning which occurs. 
Larger schools tend to operate multiple co-op programs with each coordinator specialiiing in a 
particular family of occiipationi. In smaller schools, co-op programs are operated either by a single 
coordinat(||' responsibla, for a broad range of occupations or by individual vocational education 
teachers. 

Another requirement for co-op education programs is the formation of a local advisory cdm= 
mittee representing the various interests of the trade, occupation, or occupational family involved. 

Goals, The primary goal of co-op education programs is development of the student's occu- 
pational competency. The occupation the student studies in school is based on his/her stated 
career objectives. The special goals include: 

• Career decision making: Students gather information which is useful later in making 
decisions about type of employer, place of employment, and requirements for advancement, 

• Good work habits: Students learn the personal and interpersonal habits that are required 
to find, maintain, and advance in jobs, ^ 

• PJacmrmnt: Students have an advantage in finding fuli-time jobs. A student who performs 
effectively In a co op program is very likely to stay on in full-time employment after 
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completing the school program, As a fesult,^#^pically more than 80 ptrcent of the plaTC- 
ment rates are in the dccupation for, which thS student is trained. 

• Rmpamibitity snd Iwad&r^hipr Students fiirn to accipt risponstBintV and take thl^riitiative 
for tasks in a mature minn^j^ > 

• Probfem-sq/ving skills: Stud^ints Itarn to resolve a variety of on-the job problemi, 

• Attitude development: Employability improves davelopment of ielf-concept, especially 
attitudes regarding one's self-worth, earning power, andl fihancial independenQi. 

• Financial benefits: Students receivejupplemental incQrne. ' ' 

• Skill training: Students learn entry lieyel job ikills. ^ ^ 
Key Prog fwm Elements. i 

• Co op programs provide in school vocational instruction related to occupational field and 
training job. 

• Work periods include alternate half days, full days, weeks, or other periods of tim«. (Num- 
ber of hours of work generally equal the number of hours spent in schooL) 

• Students' receive regular wages for fheir wo^k which is usually at least minimum wage^j^ 
a student learner rate established by the Department of Labor (DOL). Wages are paitf by 
the employer, ' ■ ^ 

• Eligible employers include both public and private employers. 

• The program is carefully planned and records are kept. The specific skills to be obtained 
by the student are defined in consultatipn with the employer. 

» The employer is involved as a partner of the school in the selection, instruction, and training 
of young workers, 

' The program is supervised by a teacher or coordinator. 

Guidance counselors are involved in promoting, scheduling, providing occupational 
information, and counseling students in the program. 

The program is evaluated by the employer as well by the coordinator. 

Students receive school credjt for on the job experience. 



59 



E^iuatimf Findings 




* 




Student compositloh. /Work Study proj^ms^re for eaonomicilly disidvantagad fulUtime 
vocational students. Thi limitations art ages fiftetn through tvyenty ytars. 

Program organiMtion. Work study programs are funded 80 pircint' through federal dollars. 
Funds are used for— , 



2. development and administration of program, ' 

Wo r|< study programs are administered by the state or local educational agencies under supervision 
of the State Board for yooational Education in accordance with state plan proviiions. 

Goals. The primary goal of wprk itudy programs is to hqlp disadvantaged students begin or 
stay in school by providing them with some financial support. 

Key Program Elements. i 

f Students receive in-school vocational instruction not necessarily related to the job, 

• Students work a maximum of fifteen hours per week wNle attending school. 

• Students are paid $45 per month, $350 per academic year, or in certain cases $60 per 
month, $500 per academic year. Public funds are used for compensation. 

• Students do not receive academic credit for their work. 



Postsecondary Cooperative Education Programi 

A more general type of cooperative education is prevalent in four-year colleges, universities, 
and a number of community colleges, Its purpose Is somewhat broader than the vocational educa 
tion co-op programs. Study and work are normally alternated in separate blocks of time. Coopera 
tive programs of this type may be given partial federal support under the Higher Education Act. 



1 . damptns^on of students employed; 



t 



Evaluation of Coo^rative Education Programs 



Report 



' NunierQui studies^f co op/work study programs have been conducted. Local and* state pro= 
grams have been evaluRd in locations such as Minnesota (Gussing 1976), New York (Soper 
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COOPiRATIVi 
NPROQRAMS 



Associates 1972), Detroit (Waynt Stite University 1967), California (Btrbew 1S63> Indiana 
(Breckner and Medley 1975). * t 



This section focuses on recent major evaluations of co'-bp/work study prp^ramsft^^d on 
national or regional iimples. The following are among the evaluations of this 

• An Assessment of School Supervised Work Education frograrns. This is a nationpl evalua- 
tion of fifty randomlv^ selected secondary and postsecondary cooperative education, work 
study, job corps, and wbrk experience programs (Prankel et al/ 1973). 

. - , ' ■ ■ ^^. '^ ' ^ • ' 

• An Assessment of Schoo/ Supervised Work Edubat^^ /I: Urban Co-op 
Work Education Programs arid follow-up Study:; This is the second part of the preceding ( 
study and focuses on urban programs drawn from national samplei (Walsh et aL 1976). 

• School Supervised Work Experience Progran9s: Co$ts and Effects on Personal Developmentf 
Education, and Employment This study, basecf on a regional sample, e\/fflBrites the cost 
effectivehess of secondary vocational education co-op and work study programs (Lewis et 

a). 1976). 

• Cooperative Education and Career Devdopment: A Comparative Sf^d^^^df Alumni. This 
evaluation colteoted information from a national crosS'Sectiona^fflffp^of co-op education 
and non-co-op education alumni at one- five^ and ten year intervals after graduation from 
college (Browfl 1976). . 

The following is a brief description of each of these studies. * 

Frankel et ah USOE launched a two part study to assess the effectiyeness of school supervised 
work education programs in 1972. Part I of the study^ conducted by Systems Development Cor- 
poration and completed in ?T973, addressed the broad sweep of work education programi Including 
cooperative education (mandated under Part G of the 1968 Amendments to the Vocational Educa^ 
tion Act of 1963)s work study (mandated under Part H of these amendments), job corps, and work 
experience (e.g., those funded under the Neighborhood Youth Corps and WCEP) programs. Fifty 
case studies were compiled, and interviews were conducted with samples of program participants 
and a cohort of students attending the same schools who were not enrolled in work education 
programs. ^ 

i 

Several reports on this study have be^n prepared including Steven M. Frankers Executive 
Summary: An Assessment of School Supirvised Work Education Programs. (Santa Monica, 
California: Systems Development Corporation, 1973); and Frankers Case Studies of Fifty Repre- 
sentative Work Education Programs (Santa Monica, California: Systems Development Corporation 
1973). 



Walsh et aL Part II of the study, conflucted jointly by Olympus Research Corporation and 
DECIMA Research focusecj on work education programs located in urban areas. It had two major 
purposes: ^ 
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1 , To i^tsi thf efff^ivenra of thm programs through the epmpilation of tm^^oisii 
, itudias 

2f To determine post-pr^ram experienees through follovv^up inttrviewi with 675 students 
pinicipathig in urban ra-op programi and a tohort of 774 vooational edueation itudmts 
who were not enrolled in cooperative education. 

Several re^rts of this part of the ^udy have been prepared including the following: 

The Olympus Research Corporation's An Ass^m&nt ofSchoo/ Supeh/sed Work Education ^ 
ProgrBms. Pan II: Urban CoopBrativw Work Education Programs and Follow-up Study Final 
Report (1976) which 1$ comprised of the three volumes and in executive summary listed ^ 
below: , % 

■ ^, 

John Walsh i|nd Vincent J. Breglio, VoluniB J: Overview of Thirty Urban Cooparative 
^ Education Prbgrams. 

Vincent J. Breglto. Volume 2: Work Education Program Outcom^-^A 24 Month 
Follow-up Study, 



Theodore Bryant. Volume 3: Thirty Ca$& Studies of Urban Co-op Education ProgrSmSi 
Walsh, John and Vincent Breglio. Executlye Summary, 



Lewis &t aL USOE sponsor^ inothar evaluation of iroondary school supervised work expe- 
rience programs in 1976. The population for this study was the largest fifty SMSA's east of the 
Mississippi River and their contiguous nonmetropplitan counties. Fifteen randomly lelecttd school 
districts from this area agreed to participate. Data were collected from thirty-three high schpols 
through— 

1. aeir administered questionnairts from 2,854 students participating in work experience 
iroqrams and comparison groups with similar characteriitics; 

v. " ■ ' " 

2. mail que^ionnaires from 2,253 former students who graduated in 1972 through 1974, - 

The purposes of the study were= 

1 , to determint the cost effectivenesi of school supervised work experience programs by 
comparing the costs for these programs (about $125^er student) with their economic 
benefits for students (i.e., wage rates and unemployment); ^ 

2. to a^ess the effects of wo'rk experience on personal development, education, and 
emplcr/ment. * 

A report onthis study has been prepared by Mogan V. Lewis, Gerald P, Glyde, Duane E. Mckie, 
and Lee Ann Kozak entitled School Supervised Work Experience Programs: Costs and EffecU on 
Personal Development, Education, and EmployrrH^it (University Park, Penniylvania: Institute for 
Reseaich on Human Resources, Pennsyh/ania State University, 1976). 

** ■ 
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Brom. A itudy fpcused on colisp co-op programi wis conductS^^lrown (1176)/ This 
study collected information from a hationally Mlected sample of twanty-four portsfcondiry Insti- 
tutions. Twilye of theae Institutions Had offered cooperativi^tdugation projrami sinci 1965 and 
twelve were compariblt in tirms of size, location, acadimic mijori offered, and othar characterli 
tics/ A Bmpli of 1427 ilumni from three graduating cfasies (1965i 1970, and 1974) responded to 
a mall survey from an original sample of 4,246, The responst. rate at 33 J percent is lomewhat low 
but appears to be fairly represintativi of the current population of co op fducation students with 
^ regard to major and Six. 

^ Thi purposs of this study was to explore the effect participation in cooperative education 
/hid on students' career development. Specifically, this included an examination of the relationship 
of undergriduate work experience to- 

: • academic major; ' • 

• choice of job after graduation; ! , . . 

• adequacy of Cireer information; • ' 

• attitudes toward their Alma Mater; 

• typeiof postgraduation activities; 

• ixient alumni felt prepared for their first fulhtime job; \ 

• relationship between first job and academic major; ■ , 

• characteristics of first job; ' ' 

• method of locating first job; 

• salary level on first job; 

• job satisfaction; 

• promotions and raises; 

• employment patterns; , - . ■ 

• characteristicsof current job; 

• future work plans, 

A report on the study has been prepared by SIvia J, Brown entitled Cooperative^ Education and^ 
Career Development: A Comparative Study of Alumni (Boston, Maiiachusetts: Cboperat^v'6: 
Education Research Center, Northeastern University, 1978). ... : 



Evaluation Findings 



Figure 9 highlights some of the major variables, methods, and findings gleaned from the 
evaluations of co^op /work study programs described above. The specific source of each finding 
is noted. 



Summary of Findingi from iygiuationt of Co^p/Work Study Programi 



INSTRUMiNT/MiTHODUSID 



Sflf-idministiffd mail qutstlonniifi 



Self=administerfd mail qyestionnaire, 



RESULTS 



Mofi cO'Op studiilts hsid initiil pqsltioni which requlrrf iome 
iptcial ikilli. However, this idvanced job skill li\|^ Is short term 
in nature; beyond the first job; no additional idvarftagi accrges 
to the fornner co-op studgnti Lewis 1976), 



^rmer work experlinee students receive nipre* on-the-job traln- 
lr| after graduation than itujdents who did not have work 
ixprtence (Lewis IfllSk 

StudentV chances'|f finding a job, related to thejr training were 
slightly increaied bV p^iclpating in work experience, Co-op^ 
students were more likely thin non-work expertfrief studints to 
obtain jobs which were related to the occupatitinal areas they 
studied, Within this group, femlfe cp-op students in office 
occupations Were the most ilkily to ohftain jobs In areas they h^i 
itLJdiid (Lewjs 1976), 

About 50 percint of the co-op students obtain jobs related' to 
their training after graduatioK Jf co-op adycation is evaluatid 
on this criterion alone, the reiulti are not encouriging. But the 
iuthori go. on to supst that this may not be theinoit appro^ 
priate meaiuri of perfofmanci, Secondary students were often 
engaging in occupBtionBl explotBtion to find out what different 
jobs Were like rather than committing tHemselves to a specific 
career (Lewis 1976), 



Co^op students acquire suitable jobs within a ihorter f^riod of 
' time after leaving high school and had slightly less ihort^term^ 
unemployment wheq they did so. About one half the co=op 
students stay on with their employer after they graduate 
(Lewis 1976). ^ ' . ' . ' ' ^ 

A — — ^ 





Cm studies of ihirty urban work 
education programv 


Ayftragf! completion and plicement rates fur secondary urban 
CO op education pranrams weri high, 

Averap cornpletion rates vire 84 porcofit;' Average placemen/ 
rates were 70 percont, The training fejated placement rate was 
75 percent (Walsh and Breglio 1976), | ' . 


Job SdtiStactrOn 


S^Hf ddfTiinistfired,fTfd!l (luestiunnaire^i. 


Nu significant differences were fuund in job batufactifin between 
^former studer^^ who had and had not had work experienD^ i^/hile 
m high school ilrim 1976). 

' — ^ 




SeriL'^j uf queniuns facubifig an 
satiSfjction With f)ay and fruiyf^ 
benefits, working cofHhtiUitii. 
ijfujIlunqFs dnd apporri|iitio^, 

\ 


v Par^cipatmc . 'idents in postsecondaiy specific occiipatgfi 
programs expressed muro positivB dititudes toward their jobs 
than nnnparticipants. 

-p i. 

1 here wae little difference irV^b HatisfdCtion for secondary 

ptUtiripciht^i dfid nnnnsrfir -^ritc nA/^l^■l^ m^l Rff-5nli^^ iQ7^^i 

^ i. if.y«i 1 ij GHu 1 uj! i[Jqi LI*. u! \VVdl3i! d! [[] Di GUI lU ly/ol 

<t ?.= • • 

The \mi satisfied gruups were ihu^: who participated m 
secondary dropout prevention lyograms^ 

■ i' 


Emph)yi?r 
Satisfactif 

■J 


1 

St'if ,i(jfrimi = t!_;rM,,, iMil (]Uf:'SIi(Vinair(' 

\ 


- — ' — - - — = ■ - . - i • • 

U-op Students were viewed as more depen^ble and as hi^tter 
workers than rugular employees (Lewis 

Firnis that hdd more experienct^ ^ :f ioperative employee! 
tended to pay them higher wigei. , 1976). 

Employers found that cchop prograf|p reduced reyr uitment ' 
costs and helped them to evaluate potential rHguter emplnyeps 
(Lewis 1976). 


Lonij Turni j 
1 1 n ploy mini' 


ifti.'f ("jrQCjfjm curTipleti'Mi 


Botli ^econdery dnd pou ^fondary participants fared slightly 
less favorably than nonp.:i iiuipdnts in employment status. 
Eighty four percent of the postsecondary and 80 percent of 
the secondary participants were working, in the service, or going 
to school compared to 95 percent (postSDcondary) and 87 per ' 
HMit (secondnryj of the nonparticipants at the chllquare level 
of 0.01 and OJO respectiv^y (Walsh and Breglio 1976), 


♦ 



Figuri 9 - Continue 




m 



(^tCOMES 



Earnings 



1^ 



INitRUMgNT/MITHOD US^ 



Self-administered mail questionnaire^- 



Foiiuw up mterviews, 



RiSULTS 



Studeriti' from, work iKpirienci programs do not earn more 
iftif two y|irs bn the job thin studints wfio have Jiot had 
,j work ixpirience (Lewis 1976), 



t At the secondary level, progrim participation had little effect 
o^avirige weekly earnings^ However; secondary students 
trBHied in speoific occupations enjoyed a slight siliry advintlge 
over nonparticipating students on their first post school job. ^ 

^ At the post^condary level, participating respondints eirned 
substantially more than their fionparticipating counterparts^ 
A sizeabip ponlon of the advantage enjoyed by pirticipating 
students in posteecondary programs may be attributed to thoie 
trained in manufacturing, marketing, and distribution and 
healthcare areas. , 

Generally across alP'^programs and occupational Gaiegories, men 
earned more per week than womgn (Walsh and Breglio 1976). 



ErnplayrTienl 

Stdbility : 
' 4.. 



f-ollaw-up intefviews 

1 



S^ilf ddmini!itHrHd mail (juerfmnndiu 



ACAPEMU; 
DEVELOP^^fENf 

AcmltjfUH 
Achieveimnt 



urban co op ur nts, employment stibHity for thi fifty^ 
two-week period#M owing graduation ranged from a 1^ of 
thirfy^three out of fifty^MO for dropQut prevention participants 
to a hi^ of thirty^eight uut of fifty=two for postsemndary par= 
ticipants.,.No significant differences were found between par= 
' llfcipiting students and a conirol group of nonparticipifits 
(Walsh andtereglio 1976). 



r 



i; The form^^work expefience student chaiiged jcps sligfitly less 
ihu first tiffl years Ifter graduation (Lewis 197t 



No findings reported. 
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Educational 
Awar§nm 

toward * 
Learnjng . 
&.School 



Informed 

Couriy 

Seiiction 



CAREER DEVfLOP 
MEhjT& LIFE SKILLS 

Cdmr Skills 

Occupational 
Knovi/ledgu 



Self=administered mail questionnaire. 



Qm studies of thirty work education 
program^ 




Solf^adfTiinistered mail questionnaire, 
1 



A nonstandardi^ed occupational 
kriowllcl^ test consisting of seventeen 
items, each of which included a short 
jo^) title arid three short descriptions 
of job di^ies,.only one of which was 
correct, * / 



EKLC 



Co=op studinti were more likely than part-time nonschool 
lypervised workers to report that they were well prepared for 
their jobs and that they were learning more both in their 
courses and on their jobs (Lewis 1976). 



Participants in the urban co=op programs expressed more posi- 
tive attitudes toward school and work than nonpartitipants= 

■ • Postsecondary participants exprissad morp satisfaction 
thin seGOndary partioLpants. 

* Women were less^^nfisfied with school and jobs than 
liioir mala counterparts. 

• Postsecondary minorities expressed mo^e positive atti- 
tudes than nonm^qorijv participants; at th^secondafry 
level the opposite wK true (Walsh and Bh^t 1976) 



y 

Signifjcantly more co op students, both mal/and female, had 
jobs that were related to their classroorfi st4diei. A greater 
perceritage ot these students reported their classroom 
studies were either good or very gg^preparation for their 
high school employment (Lewis lf76L 

Co^ops reported preparation for emplovment as the reaion for 
their courie choices more frequently than any other grAp 
(Lewis 1976K ' * 



Holding a^b while in school-school supervised or part-time 
-is associated w^th scoring higher on an occupational knowl= 
edge test. The diffirencei imong the groups weri not large but 
were statistically significant. These resets were rqund even 
when the influence of sex, race, and iCwere held constant 
is 1976). 
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\ 



OUTCOMES 


INSTRUMINT/METHODUSED 


RESULTS 

- - - -.-.^ML-..^ - ----- 


Career Planning 
and Choice 


A -— . , - - - ■ 

Self^administered mail questionnaire^ 

> 


Almost 50 percent of the j/vork e)<pirience students plannid to 
continue their fornial education after high schooL Results from 
the former students showed thit these were largely realized 
(Lewis 


Emptoyability 
Skills 

Work Habits 


Self^administered mail questionnaires. 


Co-op SLddents are less likely to leave their jobs or be absent 
fiom work than regular employees (Lewis 1976). 


Life Skills 


— ■ - ._. 


fio findings reported.. 


PERSONAL GROWTH 
DEVELOPMENT 




No findings reported, 


Interpefsonul Skills 


X ^ 


No findings reported.. ^ 


SOCIAL REMEDIATION 
Econc^ik In.. ::dtors 

' \ 


i 

i 

.jiji^} nudios of fifty urbtif] work 


i 

^^iih'it^intisl riiimhpr^ nf rfiinfiritv di^ifidvantaopd and averdQH to 
below average students are being enrollud in urban co-up edu^ 
cation ijogranis and these programs hove been designed 
specifically for these students (Walsh and Breglia 1976), 



ERIC 



■j i 
1 


Coil questionnaire completect by 
school officials was used to calculati 
an average cost to schools for work 
experience programs, Tins figure 
wa*i >rnmh3rpri tn 3 nushtifiprl Hphp- 

fit fictyr (i^e., wdgei and unemploy^ 
fnentj to compute a Cost/benefit 
ratio. 


The average cost per student for high school v^ork experience 
progrimi ii S125*above the regular per pupil ixpendituris. 
This is not a cost effictive expenditure when viewed from 
strictly icorlQ^ic perspective and compared to the larninp 

f^f TnffYior \Aif^tf P Y nisVi anpo^t 1 Irian 1 6 STtfiP nifln ci^nnA 

1 . \ 


.Social Indicmrs 

School Return, 
rtetention. mi 
Completion 


■ ' ■ r 


Work study students were the most likely to think seriously 
about dropping out of school and to report that they disliked 
schoof and were getting poor grades. However, one of their 
primary reasons for not dropping out (which differed sig^ 
nificantly from other groups) .was holding jobs-'ji^ile in school 
jLewi^. 1976) U 

I 


Reduction of 
School TrUdMCy 

4 


Self-adminibtered mail questionnaire. 


Students without jobs are more likely to be truant andHkip 
more days of schooL Male students with jobs were the least 
likely to be truant (Lewis 1976). , 
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Synthifis of Evaluation Finding 

The evaluations of co-op programi have bten quitt comprehensive and varitd.^lt appears 
that cooperative programs are iuccesiful In teaching students entry level job skills and in helping 
students quickly find employment in their area of training. Over time the Initial emph yment 
advantage for co-op students set m^o equalize to the level df students without co-op trailing. 
For example, two years after completion of training, no significant differeN|ei between co-op and 
non co op students were found in earnings, employment stability, tong-term^imployment status, 
or job satisfaction. " \ \ 

^ ) 
Co-op students appear to have more poiltive attitudes toward their educational programs 
than non-co op students. Co-op students are less likely^ to be truant and more likely to stay in 
school untikgnduation, when they hold Jobs, Variablts such as self awareness, interpersonal skills, 
and life skills were not measured sufficiently to provide conclusive information. A limittd amount^ 
of information on career skills and work habits reveal that co op students may be gaining more . 
ground than their non-co-op counterparts in these areas. 



Evaluation Problems 

Evaluations of cohdp programs have tended to avoid nneasuring career development and pp^'^ij^p 
sonal growth variables, although these programs claim to build students' skills In these areas. 




I Program Description 

Overview — * 




_ The Neighborhood Youth Corps (^YC) was created in 1964 under Title l-B of iygco^pmic 
Opportunitv Act, Thu NYC prsgrams were terminated with the passage of tKe Cd^rlrlhi^ive 
Employment and Training Aft (CETA) in 1973. However, the focus on youth programs ha slien .^1^^^ 
Picked up through Title III of CETA and more recently and direct! v through the Youtl^tf^LfW 
mentand Demoastration Projects Act (YEDPA) passed in 1977, NYG%as designed tb^^Lo^&^y 
people back into school, to keep them m school, or to increase their chances ofbecoming empffl 
Since more evaluative information is available on NYC than YEPDA Programs, the former werei 
for this analysis, ."ir 



Student Composition 



1 he prograrx^ prps/icled part timu work eKperience, remedial education, and^to^^job training 
for disadvantat^ed youth from the ages of fotJrteen to twentv^-four who either dfl^^^jS't^Smplete high 
rSchool or were r)oterrtiafi ^'"gh School dropouts V'-^"' 

Program Organization - 

NYC consisted of three distinct ^ur related prograrng: a full-time progfarti.for iiigh school ■ 
drofiouts, fi \ibH time ji^b school program tor youths, and a summer employ^^jerjiprogram. The 
in s(:hr)ol f^irogram emphasised job market orientation and work- experiendfeiVvThe out=of=school 
and summer prograrns emphasized^skill training. 

*- " '■ ' . ^ 

FhiMji^hool prograrTi\ which is of prliTia|y interest m this document, attempted to motivate 
and ecH^HtTyoiAh to stay in schooi; to fjerform tetter academically; and tQ make sound career and 
HducaTional cjjoices. ErvrolieeS wern [jrovided with part time employment while attending classes 
-.jiid. in^ rTj^ff^ cases, summer jobs were miade avfailable. fVlost"M,.J\J YC enroMees were in the ninth, 
tf'ntii. or eleventh qrades Apfuoxim^ti-iy on^rnillion youth from low indome famiMes pdfticipatud 
in in school f\IYC proc|ram t)fnween 1064 ant J 1972 = 

•A.lapte.l from C, R. PHtr^,, a,' j\ Anderson, fi, L. Rowan, urui H. R. Nnrthruf) Thp Impart 
nnH,v,^rn,nf^mf Manpnwf^r Pm(/r^,n)s mulasM Universitv of Pennsylvania, 1975) 
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§va fust Ion Findings ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^g 



Program Operation 

NYC projects were administered by state and local governments and by private, nonprofit 
agencies, Progranns varied in the degree and type of rennedial ptfucatlon and supportive services 
offered. Training and services differed by site and sex: for the most part, females were placed in 
clerical and nursing positions while males were assigned to custodial and janitorial slots. 



Goals . 

The goals of NYC whether implicitly or explicitly stated; can be summarized as follows: 

1 . To increase the employment of youth 

2. To increase the lifatime earnings of enrollees through training, work experience, and 
incentives to stay in school and work 

3. To reduce teenage crime 

4. To rediStribLjte income to the poor 

5. To provide skill training for entry level positions 



Evaluation of NYC 

Thert hav^^en Wjo major evalyations of the in=school component of NYC. Gerald D, Robin 
(1969) assessed the behavioral changes that could be derived from participation in the NYC pro= 
gram In Cincinnati and Detroit, Gerald G. Somers and Ernst W. Stromsdorfer (1970) conducted 
a cost effectiveness study based upon a nationwide sample of in-school and summer participants. 

RobiQ. In the Robin study, evaluation data were obtained from selected groups of NYC 
youthsjn personal interviews conducted at three points in time over a one-year period. These 
were supplemented by information collected from school files, police reconfis, and interviews with 
a subsample if the mothers of the interviewed youths. Tour distinct groups— year round enrollees, 
summer only enrollees, program dropouts, and control subjects=were selected as samples for study. 
The number of white youth interviewed during the initial nhase of the investigation was too small 
for meaningful statistical treatment; therefore, the evaluation was restri^jld to a study of black 
youth. , ^ 

Somen and Stromsdorfer. The extensive study by Somers and Stromsdorfer of a nationwide 
sample of NYC participants employed mu; iple regression and cost effectiveness analyses to in- 
vestigate the costs and benefits of the program. Social, governmental, and private benefits were 
measured. Based upon information gathered about participants enrolled in sixty in school and 
summer NYC programs snmetim&^etween July 1, 1965 and June 30, 1967, the labor market and 
educational performances uf both the sample M YC nmup and controls were ascertained. Data are 
provided by race and sex = 



Other evaluations. Several other evaluations have been conducted, A study conducted by 
Walther, Magnusson, and Cherkansky (1971) inquired in j the impact of NYC on the high school 
dropout problem. 

!n the series of reports comparing the NYC programs of various inner city areas, Regis H. 
Walther examines the impact of NYC at different points in time. Using control groups, Jhese 
studies try to measure the effect of fhe program on the educational attajnrrient, employWnt, and 
attitudinal changes of the inrollees. The impact upon education is measured on the basirof returns 
to schoBi, participation in rerfiedial education programs, school attendance records, and educational 
achlevemenj tests. Changes in labor market status are evaiuated on the employment activities of par 
ticipants at(various time intervais after leaving NYC; this includes an analysis of the number of job 
changes incWred by NYC participants. The nature of termination from NYC was also investigated 
Termirtsfis^^'Gre classified as leaving the program for one of four reasons: 

1, Planned terminations femployment, iram!ng, school, or military reasons) 

2. Administrative reasons (expiration of aqreement, completion of standard term, or 
ineligibility) 

3. Premature, NYC initiative (poor attendance, fired, misconduct) 

4, Premature, other (quit, could not qdjust, lost interest, moved, married, family problems, 
preynancy, committed to an institution) , ^ 

The basic format used was the same in all of the Walther studies;, thus, this series of reports might ^■ 
be considered one analysis ot NYC, 

The Olympus Research Corporation sTudy, "The Total Impact of Manpower Programs: A 
Four C^ry Case Study/' donta ns subjertive judgments based on impressions gained from interviews 
on the labor market impact .'^f several manpowei programs including NYC, 

Herman and Sac )fskyi^1967) atternpteu ^o assess changes in self esteem and work attitudes 
six months after enrollment in NYC. Tfie study was bssed upon attrition rates, respondents' views 
of NYC, and the impact of NYC assignments upon the new working life of the respondents, 



Evaluation Findings 



SofTie of the maior findings from these uv^iluations are highlighted in Figurfe 10. 



Figuri 10 

Summify of Finding from Evaluations of NYC 
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INSTRUMENT/METHOD USED 


RESULTS 


JOB SKILL 
DEVELOPMENT 


« 
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= •i\ r 


Job Skills 




No findings repofteti 


Job Pldcment 
& Retmt.ion 




- " - 


Job PldCBfnent 




rarticipants in the NYC were employed more, and out of the 
libor force less than controli Iri the post high ichool piriod. 
However, participants had more months of unemplovment 
(Somers and Stromsdorfer 1970). 


i 


■ 


A control groupiEtudy based on a'nation\^|^s3mple of the 
in-school Neighborhood Youth Corps revealed negligible 
differences in earnings between participants and controls. 
The study revealed total before m earnings for partici^nts 
in the post high school period as $4,159 as comparid to\ 
$4,24? for controls (Somers and Stromsdorfer 19701. 


i 




A.four^ity case study of the total irtipact of rnanpower pro= 
grams indicates that, as a.group, participants in manpower 
progrartii efijoyed higher annual earnings in the year after 
training than they did in the year or years preceding entry 
into training. Trinil^it&d Into annual inconne equivalents, the 
average enrollee giined Si ,380 or a 40 percent irpcrease over 
the thirty-six month period prior to enrollment/ However, the 
average enrollee was still earnini at a rate of $3,000 per year 
(Olympus Research Corpciatlon 1971). 






Across the four cities, the average hourly wage rose by %A2 m 
hour between the year prior to and the year after enrollment; 
The average post training wap rate exceeded S2.00 per hour- 
the level required to achi^we income slightly above the poverty ; 
line-for fulhtime, full year employment (Olympus Research 
Corporation 1971). 



EfTiployment 
Stability 

« 


i 

Case study. 


A four-ditykase study of the total impact of minpower pro- 
grafTis found only modest pr@/post training increases in empioy^ 
ment stability (percent of availabig tirrig worked by those 
reporting employrrient in a given time period) and emploympiit 
intensity jpercent of total potentiil time worked by the total 
trainee group), The highest post training rite was only 70 per- 
rent for impldyment Stability and 50 percent for employment 
intensity (Olympus Research Corpontion 19?1). 


ACADEMIC 
DEVELOPMENT 

Amlmic 
A(:hf0mmit 


School fjl^j. 


. i 
\ 

An analysis of black NYC participants based on data collected 
through school f\\m revealed no evidence that NYC had a favor- 
able effect upon the scholastic achie ^emant of its enrollaes. 
In faqt^ since enrollaes spent time working instr it! ul di their 
studies, participition in NYC impaired grades of enrollees who 
hid previously performBd adequately In their studies (at l^st 
C averaqe prior t)6 enrollmehtj iRobin 1 969). 

k 


EiJiw^tjUfhil 
Awdrenm 




No findings reportec 


CAREER DEVELOP 
MENT;^ LIFE SKILLS 

C^reOf Skills 

i 

■(, 


Rdtiny K'dle. 

's 


i \ 

Enrollee^ rated the NYC out of school program in four om on 
a five-point scale ringing from "not at all useful;' (1) to ^'very ' 
usefur' (5)= The mean rating of overall usefulness was qenerally 
. over 4, with fefiiale subjects indicatifig a niore positive 
sponsetathis question. Enrollees' estimates of theii chances 
of achieving their ten^year occupational goals were also/ioted . 
Most of the study subjects had employment objectives that 
were perhaps beyond th^ir capacities to achieve, in that they 
required new job dnd training experience. Approximately 
three^foiirths of the respondents, however, rated their chances 
of goal achievemQnl i^ery good'' or 'lairly qood'' 
(Walther). ' f ~ 
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OUTCOMES 



Emplo^dbilny 
kiL 



Work P^ttftudes 



Lik Skills 



PERSONAL GriOWTH 
DEVELOPMENT 

SelfAwmrwss 

Self Eneem 



INSTRUMINT/METHOD USID 



Interviaws, 



RiSULTS 



A study comparing enrollees of NYC's in^scftoo! prograin and 
a cafofuily chosen control group In two citjiis^Cincinnati and 
troit-concluded that the program had no discirnible im- 
ct on the youths' conception of work, their willingneis to 
relinguish the security of steady training that would pripare 
them for better jobs, their perception of conditions which 
may interfere with obtaining suitable employmint, their 
professed job characteristic preferences, or their occupa^ ^ 
tional expectationMRobin 1969L 



No findings reported. 



A review of black Neighborhood Youth Corps participants 
six ftionths after efirollment concluded that there was 
an initial positive shift In self-esteem and work attitudes 
IS a result of participition which thereafter tended to 
remain stable jHerman and Sadoksky 1968), 



jntetperwndl Skills 



N: findings reported. 



SOCIAL RB^bDlATION 
Etmomi( IntjicmiH 
IncgmeTfansfHr 



I ! i , 



-FRir- 



6 



The four-city nudy assessed the Iniome transfer of the Neigh- 
borhood Youth Corps (NYC) as ''needed, and though some of 
the experiences may have imn counter productive, most of it 
was probably, better than none" (Olympus Resiarch Coipora^ 
[ion 1971). ' 



Sp^ial ti^lmors 

Schoui Riftpnijon 
& ComplBriari 






f 


In ti study of the NYG put-ofichooi propm, the mvesiigatofs 
found ttiiV femole participants were more likely to return to 
school and to cornplet§ high school when they did return, than 
were males. The study liso rgvealed. however^ that d greater 

rujFrpnf jnrj nf fhp rfintrnl nrniih than nf thneu In MVP rntnrrn H 

toschooL It appiars that the impact of NYC on schooN^nroil^ 
merit woe either noneKistent or very limited (Walther, Magnysson, 
andCherkasky 1971h 


i 
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1 
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Another itudy of NYC's iti-school program found that the pro^ 
grdm had no statistically significant effect on the probability 
of high school qraduation or on tha years of school completed. 
1 1 wds also found th^t for NYC participants as compired to 
their control group counterpirts; blick ferTiates are 12.B per^ 
cent more likely tdpduateand American Indians are 141 
percent more likel^to graduate. 
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One analysis of the Neighborhood^ Youth Corps summer project 
in Washinyion, \)..C. found an inwse relationship bftween the 
the number of NYC slots and the incidence of crtmu This study 
concluded that NYC had a sliqhtly beneficial irTipact upon aqql=e- 
gate juvenile delinquenKy statistics but this alleged relationship ^ 
did not appear to be statistically conclusive (DOL I9?2j. 




% 
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Another study of NYC inichool and summer pii. 'ams delh 
neeted thij delinquency profile for participan! ' ne periods 
before they enrolled m NYC, while th^ were w ng in the 
program, and -fforn the fWint of enrollment to the date q\ * 
offense cheekMTtt|'$|udy concluded that "NYC participation, 
amonn both rtiafel^id females, is unrelated to delinquendy 
prevention of,^diiCtion." \ 

i 

t 



^Summary of Finding ' . 

Despite the large number of reports on the Neighborhood Youth Corps, ^ew attempted to ^ 
assess the impact of thi program. Evidence of differentral impact by race and sex is limited. Some 
studies, however, discuss theief feet of the program upon the labor market performance, educational 
achievement, and delinquent behavior of N*YC participants. - . 

. ■ I' ' 

In terms of economic impact, the findings revealed fria^^dfertipared to tjie control group, the ^ 
NY€ group= 

• was employed slightly more months since leaving high school but this was not statistically 
significant; 

' ' ' 1. ■ 

• experienced slightly lower hotore tax earninqs but th\} was not significar.tly different; 

• was out of the labor force (unemployed) a somewhat shorter tlme^ 

• haH significantly ^higher post high school gross earnings (this is attributed to the smaller 
number of months of labor force withdrawal, on the part of NYC participants).- 

- . ^ . I 

The findings reveaSed that male NYC participants as compared to female participants- 

9 earn more; . , ^ ' 

• ii|ve less volunrnry labor force withdrawal; 

• shov^ no differ^ce in uriernploy merit. , - - 

When conipared with. their respective control groups— ■ , 

'r|4| * NYC males earn rnoru while NYC females do not; " ■ 

At^ ' ^ ■ " - - ^ '.. 

^ '^ • NYC femalp are unemployed rnore, have fewer iiQurs of nonldbor force participation, 

and work less hours per week. 

The studies jernonstrate that blacks benefit more economically than whites frprn-N YC witti / 
positive gains^ evident among both males and females. The benefits attained by black femalei 
accounT for much of tBe overall gains of the total sample. 

In terms of noneconqrnic impacts! t was concluded that the NYC prnyram had no statistically 
significant irr^act upon the probabHity of^fiigh school con [jletion or the numiber of years of school 
completed. 3. 
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Evaluation Problemi ' , m * . 

The eKtent tOM/hich paFticipation in manpower prograr^l has resulttfS in incriased schoofing" 
is difficult to document. Difficulties arise in measuring schoof achievement becauie many of the 
|OTrollees do not have the attitudes toward testing as^ciated with middle clafs society. Many ttsts 
11^'" defining academic gains have been found to be culturally biased. In additionpcomparisons 
ades completed and educational attainment of groups are inconclusive. In'many cases, the act 
formally withdrawing from school may have ocrurred years after the individual had lost interest 
attending class. ^Graduation from high s6hool is not necessarily synonymous with educational 
Mils; even those who have a high school diF?homa have been found deficient in redding and aritH^ 
^ metic skills. ^ r ^ - 



SECTION III 



CONCLUSIONS ABOUT 
^ ASSiSSING 

||XPERIENTIAL EDUCATION 



In the conclusion a summary of the evaluation findings is offered. In addition, sik issues are 
discussed which appear to be of particular concern to evaluators. Insensitive measurement tools, 
lack of control over learning expg rienrfes, and heavy use of classical research are dtfered as^ome'of 
tne problems. ' = " 

E#<^»rigs often indicate the need for new beginnings, fn this lights we suggest the need to per^ 
haps consider some alternative approaches to evaluating experiential* education programs. 
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Synthesis of Evaluation Finding , t 

ij> '' ■ ' ■ ' 

In this section evaluatic^ryrfiids or patterns rtiulting from the analYiis^f the five ixpiriential 
education programs wili-be ^fcu^ed. , Figure 1 1 provides an overall summary of the finding and 
outcomes. This figure was d^lyVd by listing the eleven major outcomes (from Figure 2) along the 
left margin. Across the top of the chart; the methods used and findings from the evaluation studies 
are displa^d. The methods used in the evaluations of the five programs were. classified as paper and 
pencil tests, questionnaires, interviews, case studies, and record reviews. Within this classification, 
the target populations for the evaluation study havelfaeen id^ified, Theie target populations in^ 
elude program students, program and cpmparlson students, prd^Sfrr6articipants,'and parents. In 
addition to the methods used, the findings resulting from the evaluation studies.have been classified 
as evidehce supporting the outcome, #Oldence not supporting the outcome, and no evidence re= 
ported. The numbers in the cells represent the frequency of methods used and^^he corresponding 
findings that resulted for each of the eleven outcomes. Thus, jhe extent tg whichthe ^ults of 
these methods found positive evidence that the program outcomes were achieved can be tentatively 
identified. . / * ( ' , 

- . " . .Vl ^ ' . ' ■ / ^ 

The reader should keAi in nymd that th^lsults of Figure I T are not as precise nor arftidy^s 
they appear. The outcometTepr^esent the authors' bkt judgment regarding a frameworkxor desert, 
ing goals and outcomes. The evaluation results we^^ammarizedand forced into our classification 
frameworks. Not all reviewed studies prqylded ex pi ibtt research design information. Tor o^tample, 
a case study may have included both questionnaires an^Hnterviews. It'was not alwaystpbssible to 
separate the methods used to collect the dd^a from^the ^^bcted evaluation findings. Finally, the 
classification of the findings in Figure 1 Tare based on the'judgment of the evalfciators of the five 
programs regarding whether the evidence supported the achievement of the outcome.** 

To aid in the interpretation qfjhJ^ information, an example is provided. One outc^e iden 
tified for the goal of job ikill da^lopmV>t was job skills. For the programs reviewed, one prograhi 
evaluation reported on flm+rfgs relating tC( job skills. In this instance, a self^administered question- 
naire was n^ailed to program participants |trea|ment stud|pts) Ovho had completed the program. 
Findings from this questiQnnaire S|Lggest0d that students had obtained initial jobs that .required 
special ikiUs tearnec^o^he experiential education progrSm. Thus, the evidence suggests that the 
outcomeis being acm^lli ^ For purposes of deriving Figure 1 1 , the cpnclusions appear to'be more 
precise tWk they acti^p/ are. Hence, Figure 1 1 is artificial to the extent that it^oversimplifies the 
complexity of the fln^gs especially as tfiey relate to their fiill intierpretation in relationship to 
other supporting evid^fte. .^ ' 

Even with the a^^e limitdtioni Figure 1 1 provides sor^'insights^as to patterns regarding the 
evaluation of experiential education programs. Case studies and recoTd reviews were the least used 
techniques to find evidehte that thi outcome was achieved, gvidence that supported the achieve- 
ment of the outcome was more frequently found ^from the use of questionnaires and Interviews 
than from paper and ppr^jl tests. It would appear tharthe rinore^he evaluators'judgnnents are 
required to interpf# the"^ information, the greateh the likelihood that the ou^'^me is achieved. 



Flgurs 11 ^ ? ^ 

Overall Summary of thd Frtquirfey of Methods Lhtd ind \ 4 

Thflir Findinp as They Relate to ivaluating Out^mes "^0^ 
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Using a control group for comparison; regardle^ of the mtthod, tended h dwrtjse the Hktil 
finding evidence that supported the achievement of the outcpme. It may be that in rtalRy tK$1 



comes are not being achieved. However, the authors believe this Js not the cast. It is our bpjb^ 
that the lack of evidence from classical research evaluations (experimental studies) may be due i 
such factors as: the lack of a defensib^ ^andard or n^nxto compare results; inippropri^tejy 
chosen control or conriparison groips; insensitive paper and pencil tests; or heavy rt Nance on statis- 
tical methods'to detect subtle changes jn student behavior. Our view of the prpblems^siociatid 
^ with evaluating exper ientiaf education pr^rams is presented in the follo^ng stctlon ( 

^ ■ . / . ^ ■ . tij ^ 

Problems in Evaluating Experiential Education Progn 



e effective- 



There are two basic questions that an evaluator asks when attempting to^! 
ness of a program: - 

1 . What should be measured? /: ^ 

2. What is the best way to measure it? 

A variety of problenis^ plague the aspiring evaluator of an experiential educatt6n'p'rigfattt'f s^^ 
attempts to answer these questions. The probl#Tis stem from^oth th^ characteristiQSOi thf prb= 
grams and limitations in the methods applied to evaluate then 

The authors have placed the evaluation probtems intp si 
discrete but represent our judgment regarding major area^ of c 





egories. The categorjes are not 



T 

2. 
3. 
4. 



Evolving objectives of experiential education programs^ 




m expHSnerytjal^dUcgfi 



on^rograms. 



Skirting important outcomes in evaluations. 
Lack of control over the learning ^xper} 

/ 

Insensitive rneasurenient tools. 

5. Subtle effects of eS'periential education 

6, Emphasis on classical research. 
Some examples of these evaluation problems are highlighted in the followin^ections 



igrams in affective areas. 
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Evofving Objectives 

■ ' : ■ ^/ 

It is difficult to tie down and clearly state the specific objectives of experiehtial education. S' 
It is hard to specify objectives for any program; but, this is especially true of Ixperiential learning. 
The objectives are often ambitious and broad, students' experienqes are diverse and individualized, 
and the nature of the program is "experiential" rather than carefully preprogrammed. 
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ObjectiN^i art often ustd for purposes other than program planning and evaJUatiqn iucl^f s 
getting fur^dinfl, gaining school support, and gaining community support . The t^i^ie object ivei of a 
progrim may not he: tht stated objict ' * 

" A hfdden cMfficLilurh that mori accurately reflects the purpose of a pro^ 
. Crovve an^ Wilkerjn the Evaluation of the Executive High School Internships 
. Sunim9ry\ AKhoug'h difficult to ferret out, a hrdden curriculum may exly th 
ax'pf asset tKe ft^ impretisii goals of a program 

Dtfinjng measuraBle objeetives may riot be fn the best interests of the program* 
work^. increaiai the risks, and promises no obvious professional reward for success, P 
apers Often pereejve tMat unm#asurablfe pbjectiyes are an asset in that they help to ret 
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irisure suA^ivaU ih additfon, becauie pf the nature of experiential learning it may nQt be to^sibde 
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to itate obj^i^es at the same level of measurability as for a math class, for examp/le. 

The authors propose that an exarnination of goals of experiential educafion pr^granl%is 
required before developing ^ full blown evaluatipri study. Figure 12 displays our notio^^f^tro 
'^relationship between goals and consequences of such prog . ; 



Figure 12 

Relationship of Goals and Consequences 
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Observation of this diagram reveals four cells that could result frorn intended and unintended 
consequences resulting from^staied and nonstated goals. Of course unintended consequences are ^ 
thosaoutcomes tha^were not known or\hypothesized prior to an evaluation. Once the unintended 
consequences have been identified the/ become intended. We have labeled goals as stated and^ 
nonstated because our experience suggests that implem^nters of innovative programs have a public 
^stated) and private (nonstated) agenda with regards to their program. The stated goals are those 
that are ptdagogically sound, politically safe, and philosophically coherent. The nonstated goals 
are those that are in participants' heads and motivate them tp actively participate and support the 
program. ■ ( * * 
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• tea rnlng'^flt 'work environmenti are really like? 

• tearnifilgfeorf |bout fhemselves? ^ 
■■\ • WrnliiBlpeclTO job skills? ' 

Vjfr. elarrfylng c|re6r plans? 

learning a combination of all the above? 

Unfll Wa fjtidll^ through careful observation about what students are actually learning from 
tbise pftografTis, ft is arbitrary to evaluate them against preordained objectives. 

Skir^^vimpwtant Outcomes in Evaluations 

:i>";v OwWngpvhich outcomes of experiential education programs should be measured is a difficult 
• task, Ont fihm continually ask the question: Are the things vye can measure well the most impor^ 

tant to mtasure? Variables that are tougher to measure such as Job satisfaction, work attitudes, and 
, ^h^BBrMf^ often overlooked in favor of those which are easier to measure, i.e,, job placement 

^d iicadei^ic achievement. , 

^ ^ ^ ' ' 

.vLirTyttfd Coritrol of the Learning Expertences K . ^ 

in Ejcperiential EduGation Programs / ^ 

There is less control over what students learn in a work setting than in a traditional classroom. 
The school has limited control over the role of the sponsors (employers)=their level of commitment, 
frianner of working with the student, or their skills as teachers. Each student is pl|Ged in a different' , 
environment with a different sponsor in a different job. In essence, no two experfences are the same. 

fUdents' experiences are influenced by the type of environment in which they are placed (e.g., 
a fSfti versus an office versus a factory). The students' experiehces are influenced by their sponsor 
'employer) who is usually not trained in teaching. Because there is only limited control over the 
Jiarning experiences, it is difficult to develop precise parameters for evaluation. ^ 

Insensitive Measurement Tools . ' % 

The si q^n ce of learning in experiential education differs from the sequence of learning used 
m the classr^Pi, Many experiential Id^arning sequences begin with appiication-pf rforming a task or 
learning how v^aork environments actually operate. Knowledge and understanding of the underlying 
principals and theories grow out of doing. The classroom learning sequence begins with knowing and 
understanding bits of information which are fater applied. This basic difference makes many techniques^ 
tliat are appropriate for eyaluating classroom learning inappropriate for evaluating experiential education. 




Cognitive paper and pencil tests which attempt ta miasure learning through abstract cognitive 
^ructurts may fail to measurt the reality based knolv how students gain from expiriential learning. 



Subtle EffSQti of Programs In Affective Areas 

Many of^the expected outcomts of experiential education are affective in nature. Significant 
pre post difftrinces in affective variables luch as self-esteem, job satisfaction, attitude toward work 
or refationships with others are rarely found in past evaluations of experiential education programs. 
These iffects, when they ocfiur, are often subtle and difficult to pickiip through the types 
of measurement tools used; for example, a frequently used measurement tool in some type of self- 
rating format. However, self ratings tend to be high for most people most of the time. This leaves 
little room for growth to be measured through pre post or control group testing. More sensitive 
and perhaps indirect measures of affective outcomes are needed. 



Classical Risaarch Versus Alternatives ^ 

Classical research paradigms may have limited utility for testing the effects 'of experiential 
education programs, especially in the formative developmental stages. While classical research can 
provide inforrrfetion to individuals, the conditions appear to be such that experiential education is 
not ready for thimype of in depth examination. .The emphasis on using classical research paradigms 
in evaluating thw programs can lead to experiments that are elegantly designed but often limited in 
scope and relevance, Thf logic of experimental research for the hard sciences is undefeatable yet 
ij has often not served us well in evaluating these programs. The rigidity of the experimental model 
i;nay, in fact, perform a disservice in educational evaluations. It has encouraged us to examine hypo- 
thesized effects of programs without learning much about what really. happpned in ihe iprogram, 
whal students actually learned, why the program worked or failed, or what^eatur^pff the program 
were most and least effective, A rigorous experiment is expensive in term^^of time, dollarsl^and 



energy needed to conduct it. Yet after outlaying resources we pften find nc significaQt dif^pences 
and little signific^ant informatiorfe to pass on to the next program ma'n^er, program &^^%iatQf, or 
decision maker. • # 

. The premature expcution of classical research m*^ force us to squ^ze a prograflpi into boxes 
it was never meant to fit, mask true program outcomes, and justify prog^m effects which may 
have been lucky artifacts rather than educationally significant effects. Figure 13 contrasts some of 
the assumptions behind experimental research with the asiumptions behind experiential education. 

These difference ' lead to the conclusion that alternatives neejded t^ evaluate experiential 
education. More emphasis on describing the actual uxperien00s of students and the ways in which 
program resCHjrces are used is needed so that we may become more's^sitive to what is actually 
happening in these programs, ,^ ^ 
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Asiumpttons B#hind ixj^rimental Reidarch 
and Experiential Education, 



CONCLUSIONS 



IXPiRIMENTAL RiSEARGH^ 



Assumti^^hit vyf know what 

the treatment js. 



Assumes that vye can predict what 
effects are gOing to happen from 
the treatment. 



J 



Assumes that a treatment is significant 
when it affects the majority of the sub^ 
jects m a similar way. 



Assumes that the treatment conditions 
can be controiled. 



Assumes that effects measured through 
group perception have more validity 
than the insight of an individuaL 



Requires meeting a complex chain 
of assumptions to generate credible 
results 

• the program had objectives 

• the program implemented 
Its objectives 

• valid and reliab^' instrurnents 
1/0 were used to measura program 

effects ■ ' 

• respondents to the instruments 
are f^tpresentative 

• control or norrTi com part sons 
are used 

• stattstrcal test's are appropriate, 
etc. 

When any link in this chain is violated, 
the results become suspect = 
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iXPiRIENTIAL EDUCATIOhl 



IS often i shoft-termj one time bnty, unfamiliir axperian^ for one 
stijdent. There is no structure comprehf nsive enoygh to define every 
possible experience a student could have in a work environment. If 
it was possible, it probably would not be functional. 



Is a unique experience for each student based on their background, 
level of maturity , work environment, sponsor, type of job, motiva^ 
tion, and many other factors. This makes It difficult to predict 
precise outcomes for individuals and even more difficult for groups. 



Expects students to profit in different ways by their experience. 



Exerts very limited control over the specifio experiences that are 
going to happen to students since the work environment has a life 
of its own. 



Because of its diversity, may be better evaluated by one perceptive 
observer or a team of observers who can preserve differen^s as well 

as see patterns. 



Is an evolving entity. A rigid framework which penalizes one for not 
knowing precisely what the program will be from the outset cannot 
capture its effects. Attempting to measure the diffuse, developmental, 
and often subtle effects of Qxptjriential learning with classical research 
paradigms is analogous to measuring a rainbow with.a yardstick. 



Aitimatlvdi to Current PraoticM 



As part of the effort aTOcitted with this rtsaarch effort, project staff investigated aiternatlvas 
to currant pramices on evaluating experiential education programs. This effort Is reporttd in a 
companion report titlad: P§r$p€Ct/ve$ on Investi^ting the Con$equBncB$ of Expenentis/ Education 
edited by Crowe and Bickman, irlefly, this effort involved obtaining four perspectives on expf- 
riential edycation and its outcomes. The ptrspectives represent^ psychQlogy, ^onomics,,inthW- 
pology, and sociotogy. Tht conclusions from this effort art presented below: 

• Extend the notion that luck or chance create critical incidents which cau$e major changes 
in a person's life, l,e., to aohsider an experiential education program m a critical incident 
in a student's life, 

I 

Rather than leaving major life changes to chance, increaie the number of experiences so as 
to irg|easa the probability of studints encountering a critical incident. The success of the 
progWm (expirience) would be measured in terms of pronounced chari^ in the.dlrection 
that a student's life took rather than specific changes in the student's behavior. ^ 

* "^'-^ 

• Evaluate experiential programs within the context of career development theories. 

i, 

The theory or framework would serve as the vehicle by which to specify how the program 
should contribute to the development of a student's career. Measurement would involve 
using individuals as their own base-line control and then aggregating in terms of the par^ 
ticular objective specified by the theory, * 

• Choose a variable that is related to program outcomes to determine the effectiveness of 
experiential education 0tograms. 

-- \ . ^ 

A labor marketwariaWt such as earnings wasjuggested as reasonable. Earnings are less am^ 
biguous than testsjcores as measures of program effectiveness and do not require elaborate 
construct! to define their meaning. Measurement would Involve repeated observations of 
earnings of participants and nonparticipants of experiential education programs. 

• Use direct observatfon to describe the structurB of relationships among individuals and 
between Individuals and their environment. 

Since standardized tests do not always explain student behavior, the use of obiervation 
would pr^ide additional evidence to expialn what really happens in a program. Measure- 
ment would, therefore, rely on the accuracy of the observations 

• Extend the scope of analysis to include social structurB. . 

ThiM^uld add the dimension of understanding the student's motives, beliefs, and actions 
as a ^oduct of social relationships. The unit of analysis would be the school rather than 
the f^dividyal. Rather than using a single measure or repeated observations, the use of 
sever^'methods to test the same points is encouraged to find evidence of program effective- 
ness, * 

• \ 
. '90 . . . / 



' The rt sutts of the effort provided' provocative ideas fpr fature investigstioni, but did not 
lead to a single approach or new methodalogies for evaluatinfl experiential education programs. 
Many of the ideas have been tried, in part, by evaluators of innovative programs. What wsi ac- 
complished waa confirmation of majiy of the techniqupi evaluators have already used but Qf|in 
expressed doubts about becauie they were not based in experimental research. The next step is to 
develop fully, understand, and implement the ideas in future evaluations. 
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